00000001:02000400:0.0F:1787602260.943288:0:2953:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787602280.869966:0:3177:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1787602283.042659:0:3237:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 639 MB/s 00000001:01000000:2.0:1787602283.292603:0:3237:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 703 MB/s 00000001:01000000:3.0F:1787602283.542378:0:3237:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4087 MB/s 00000020:02000000:2.0:1787602284.384854:0:3269:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_81_g8bf793d 00000400:02000000:0.0:1787602285.702308:0:3284:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.126@tcp [8/256/0/180] 00008000:02000000:1.0:1787602289.412899:0:3434:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787602341.129055:0:5238:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787602350.669712:0:5818:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787602350.669716:0:5818:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787602350.669899:0:5818:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000029dc3802 00000080:02000400:3.0:1787602350.669908:0:5818:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787602350.679163:0:5818:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787602350.679177:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787602350.679218:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b7e41531) 00000020:00000080:3.0:1787602350.679238:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787602350.697184:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787602350.697573:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787602350.717598:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787602350.717638:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787602350.717663:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787602350.717715:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787602350.717904:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787602350.718446:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787602350.718455:0:5818:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787602350.718465:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3640686da09dae9f 00000020:01000004:2.0:1787602350.718475:0:5818:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787602350.718479:0:5818:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787602350.718484:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000029dc3802 from MGS 00000020:01000004:2.0:1787602350.718489:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787602350.718507:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008868e50f) 00000020:00000080:2.0:1787602350.718519:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787602350.718634:0:5818:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000029dc3802 from MGS, refs=2 00080000:01000000:2.0:1787602350.718639:0:5818:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787602350.718645:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3640686da09daead 00000100:00100000:3.0:1787602350.718918:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787602350.719173:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787602350.719179:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787602350.719528:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787602350.719535:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787602350.720244:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787602350.720379:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787602350.720383:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787602350.721053:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787602350.721060:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787602350.721396:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787602350.721402:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787602350.722018:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602350.722021:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602350.722023:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602350.722506:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602350.722509:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602350.722510:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602350.723178:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787602350.730855:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1787602350.972789:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3511 MB/s 00000001:01000000:3.0:1787602351.223042:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2347 MB/s 00000001:01000000:2.0:1787602351.473122:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 459 MB/s 00000001:01000000:2.0:1787602351.723998:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 605 MB/s 00080000:10000000:3.0:1787602351.735007:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1787602351.780922:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787602351.780939:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787602351.780942:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787602351.782078:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787602351.782199:0:5818:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787602351.782239:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787602351.782457:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787602351.782482:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787602351.782918:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602351.783118:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787602351.783125:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787602351.792733:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787602351.792788:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00010000:00010000:3.0:1787602351.793174:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602351.795210:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787602351.795222:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787602351.795973:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787602351.796004:0:5818:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.126@tcp' 00000020:01000004:1.0:1787602351.796006:0:5818:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787602351.796067:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.126@tcp (typ=mgc) 00000020:00000080:1.0:1787602351.796090:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.126@tcp (00000000be1826f9) 00000020:00000080:1.0:1787602351.796108:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787602351.796207:0:5818:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d73cad0f@MGC192.168.201.126@tcp: add connection 192.168.201.126@tcp at head 00010000:00010000:1.0:1787602351.796438:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.126@tcp-0 is initialized 00000040:01000000:1.0:1787602351.796444:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.126@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787602351.802168:0:5833:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787602351.806252:0:5834:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787602351.806345:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.126@tcp (uuid 1b36f9a3-2dc4-4d93-bb16-52c7c573162a) 00000020:00000080:1.0:1787602351.806372:0:5818:0:(genops.c:1385:class_connect()) connect: client 1b36f9a3-2dc4-4d93-bb16-52c7c573162a, cookie 0x3640686da09daebb 00000100:00080000:1.0:1787602351.806384:0:5818:0:(import.c:510:import_select_connection()) MGC192.168.201.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787602351.806389:0:5818:0:(import.c:624:import_select_connection()) MGC192.168.201.126@tcp: import 00000000d73cad0f using connection 192.168.201.126@tcp/0@lo 00000100:00100000:1.0:1787602351.806436:0:5818:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000a0e17bb x1874436853596288/t0(0) o250->MGC192.168.201.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787602351.806467:0:5818:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1b36f9a3-2dc4-4d93-bb16-52c7c573162a->MGS 00000020:01000004:1.0:1787602351.806483:0:5818:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787602351.806488:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787602351.806507:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000003d27ded) 00000020:00000080:1.0:1787602351.806520:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787602351.808925:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a0e17bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3300:1874436853596288:0@lo:250: 00000100:00100000:2.0:1787602351.809025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602351.811231:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853596288 00000100:00100000:0.0:1787602351.811247:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853596288 00000100:00100000:0.0:1787602351.811314:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602351.811321:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086eb4388 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3300:x1874436853596288:12345-0@lo:250: 00010000:00080000:0.0:1787602351.811352:0:5829:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1b36f9a3-2dc4-4d93-bb16-52c7c573162a@0@lo t0 exp 0000000000000000 cur 136 last 0 00000020:00000080:0.0:1787602351.811382:0:5829:0:(genops.c:1385:class_connect()) connect: client 1b36f9a3-2dc4-4d93-bb16-52c7c573162a, cookie 0x3640686da09daec9 00000100:00080000:0.0:1787602351.811517:0:5829:0:(import.c:65:import_set_state_nolock()) 0000000080686790 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787602351.811624:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086eb4388 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+5:3300:x1874436853596288:12345-0@lo:250: Request processed in 301us (2599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602351.811631:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602351.811675:0:3300:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787602351.811684:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.126@tcp: connect to target with instance 0 00000100:00080000:0.0:1787602351.811691:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787602351.811696:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787602351.811698:0:3300:0:(import.c:65:import_set_state_nolock()) 00000000d73cad0f MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787602351.811701:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787602351.811708:0:3300:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787602351.811712:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a0e17bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3300:1874436853596288:0@lo:250: 00000100:00100000:0.0:1787602351.844574:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787602351.844889:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787602351.844896:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787602351.845633:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787602351.845641:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787602351.846168:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787602351.846175:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787602351.846948:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787602351.847219:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787602351.847224:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787602351.847850:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787602351.847862:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787602351.954435:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602351.954652:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787602351.954660:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787602351.956654:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787602351.956666:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787602351.957714:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602351.957948:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787602351.957954:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787602351.959489:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787602351.959500:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787602351.967338:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602351.967527:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787602351.967533:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787602351.968123:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787602351.968131:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787602351.968685:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787602351.968883:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787602351.968888:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787602351.969457:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787602351.969464:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787602351.999969:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787602352.000258:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787602352.003321:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787602352.005394:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787602352.005409:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787602352.007022:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787602352.007035:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787602352.020708:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787602352.020790:0:5818:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787602352.020797:0:5818:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787602352.020939:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787602352.021005:0:5818:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.126@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787602352.021011:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787602352.021013:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787602352.021014:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602352.021015:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602352.021016:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602352.021017:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602352.021019:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787602352.021020:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787602352.021021:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787602352.021023:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787602352.021024:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602352.021025:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787602352.021028:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787602352.021030:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787602352.021031:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787602352.021036:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602352.021036:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602352.021037:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602352.021038:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602352.021039:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787602352.021040:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787602352.021041:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787602352.021042:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787602352.021446:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602352.021450:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787602352.021488:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787602352.021506:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000361adc5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853596416:0@lo:253: 00000100:00100000:2.0:1787602352.021586:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602352.021691:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853596416 00000100:00100000:1.0:1787602352.021698:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853596416 00000100:00100000:1.0:1787602352.021739:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602352.021782:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0c67a3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+5:5818:x1874436853596416:12345-0@lo:253: 20000000:01000000:1.0:1787602352.021829:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787602352.021832:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:2.0:1787602352.022770:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074af02ab going to sleep for 11 seconds 10000000:01000000:3.0:1787602352.023901:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787602352.024002:0:5832:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787602352.024439:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787602352.026219:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787602352.027583:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787602352.027589:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787602352.027595:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787602352.027598:0:5832:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787602352.027612:0:5832:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787602352.028197:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787602352.028498:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787602352.028512:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787602352.028558:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787602352.028624:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787602352.028661:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787602352.028792:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787602352.028801:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787602352.028849:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787602352.028857:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787602352.028889:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787602352.028896:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787602352.028927:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787602352.028988:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787602352.029018:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787602352.029024:0:5832:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787602352.029037:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787602352.029513:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787602352.029524:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787602352.029562:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787602352.029593:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787602352.029638:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787602352.029649:0:5832:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787602352.029720:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787602352.029728:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787602352.030810:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787602352.030864:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787602352.030902:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787602352.030914:0:5832:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787602352.031403:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787602352.031414:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787602352.031475:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787602352.031507:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787602352.031690:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787602352.031737:0:5832:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787602352.031777:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787602352.036658:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787602352.037210:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787602352.037238:0:5832:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.126@tcp for mdt 20000000:01000000:0.0:1787602352.037241:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.126@tcp (null) (null) (null) 00000040:00080000:0.0:1787602352.038056:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787602352.038072:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787602352.038119:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787602352.038127:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.126@tcp (null) (null) 00000040:00080000:0.0:1787602352.038200:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787602352.038211:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787602352.038245:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787602352.038504:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787602352.038605:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787602352.038608:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787602352.038613:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787602352.038649:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787602352.038652:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787602352.038683:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787602352.038685:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787602352.043909:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787602352.044432:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787602352.044482:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787602352.044516:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1787602352.044527:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787602352.044530:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787602352.045367:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1787602352.045585:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787602352.045627:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1787602352.045685:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1787602352.045701:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787602352.045703:0:5832:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1787602352.045708:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787602352.045711:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787602352.045716:0:5832:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787602352.045722:0:5832:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787602352.046499:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1787602352.046597:0:5832:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787602352.069860:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787602352.071009:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787602352.071112:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787602352.071136:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787602352.071158:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002c820132/0x3640686da09daed0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.071179:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002c820132/0x3640686da09daed0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.071191:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002c820132/0x3640686da09daed0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.071197:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002c820132/0x3640686da09daed0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.071203:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002c820132/0x3640686da09daed0 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.071210:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002c820132/0x3640686da09daed0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.071217:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002c820132 already unused, calling callback (0000000030ed8008) 00010000:00010000:0.0:1787602352.071222:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002c820132/0x3640686da09daed0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.071229:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002c820132/0x3640686da09daed0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.071244:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002c820132/0x3640686da09daed0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.071250:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002c820132/0x3640686da09daed0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.071388:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002c820132/0x3640686da09daed0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787602352.071408:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787602352.329462:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0c67a3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+5:5818:x1874436853596416:12345-0@lo:253: Request processed in 307673us (307868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602352.329485:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602352.329589:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000361adc5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853596416:0@lo:253: 10000000:01000000:2.0:1787602352.329670:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787602352.329674:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787602352.329676:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787602352.329677:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602352.329679:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787602352.329680:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602352.329681:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602352.329682:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787602352.329683:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787602352.329685:0:5818:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787602352.329686:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602352.329687:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787602352.329704:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000029dc3802 from lustre-MDT0000 10000000:01000000:2.0:1787602352.329729:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787602352.329732:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787602352.329736:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d350c9c3370 10000000:01000000:2.0:1787602352.329740:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787602352.329776:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d350c9c3370 from 1 10000000:01000000:2.0:1787602352.329779:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787602352.329812:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: 000000005990790b/0x3640686da09daed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602352.329829:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: 000000005990790b/0x3640686da09daed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602352.329839:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: 000000005990790b/0x3640686da09daed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602352.329855:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000361adc5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853596544:0@lo:101: 00000100:00100000:2.0:1787602352.329892:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602352.329935:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bdc6de23 going to sleep for 11 seconds 00000100:00100000:3.0:1787602352.330124:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853596544 00000100:00100000:3.0:1787602352.330130:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853596544 00000100:00100000:3.0:1787602352.330171:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602352.330179:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfcc1c38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+5:5818:x1874436853596544:12345-0@lo:101: 00010000:00010000:3.0:1787602352.330196:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602352.330208:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008d014f55/0x3640686da09daede lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09daed7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.330230:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008d014f55/0x3640686da09daede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09daed7 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.330238:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008d014f55/0x3640686da09daede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09daed7 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.330246:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008d014f55, rc 0) 00000100:00100000:3.0:1787602352.330283:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfcc1c38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+6:5818:x1874436853596544:12345-0@lo:101: Request processed in 105us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602352.330289:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787602352.330448:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000361adc5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853596544:0@lo:101: 00010000:00010000:2.0:1787602352.330461:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: 000000005990790b/0x3640686da09daed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daede expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602352.330470:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: 000000005990790b/0x3640686da09daed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09daede expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602352.330512:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000361adc5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853596672:0@lo:501: 00000100:00100000:2.0:1787602352.330535:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602352.330556:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bdc6de23 going to sleep for 11 seconds 00000100:00100000:3.0:1787602352.330675:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853596672 00000100:00100000:3.0:1787602352.330679:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853596672 00000100:00100000:3.0:1787602352.330738:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602352.330771:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002720fc9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+6:5818:x1874436853596672:12345-0@lo:501: 00000100:00100000:3.0:1787602352.331012:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002720fc9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+6:5818:x1874436853596672:12345-0@lo:501: Request processed in 242us (476us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787602352.331020:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787602352.331090:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000361adc5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853596672:0@lo:501: 10000000:01000000:0.0:1787602352.331112:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787602352.331131:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: 000000005990790b/0x3640686da09daed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daede expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.331139:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: 000000005990790b/0x3640686da09daed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daede expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602352.331147:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d3509288800 10000000:01000000:0.0:1787602352.331152:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787602352.331155:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d3509288800 10000000:01000000:0.0:1787602352.331157:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787602352.331160:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d3509288800 from 1 10000000:01000000:0.0:1787602352.331162:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787602352.331194:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: 000000002c820132/0x3640686da09daee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.331201:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: 000000002c820132/0x3640686da09daee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.331207:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: 000000002c820132/0x3640686da09daee5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602352.331218:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853596800:0@lo:101: 00000100:00100000:0.0:1787602352.331254:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.331503:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000429f6414 going to sleep for 11 seconds 00000100:00100000:2.0:1787602352.331568:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853596800 00000100:00100000:2.0:1787602352.331573:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853596800 00000100:00100000:2.0:1787602352.331594:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602352.331600:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff2e3ee2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+6:5818:x1874436853596800:12345-0@lo:101: 00010000:00010000:2.0:1787602352.331681:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602352.331693:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d8eacede/0x3640686da09daeec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09daee5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602352.331719:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d8eacede/0x3640686da09daeec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09daee5 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602352.331726:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d8eacede/0x3640686da09daeec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09daee5 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602352.331733:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d8eacede, rc 0) 00000100:00100000:2.0:1787602352.331783:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff2e3ee2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+7:5818:x1874436853596800:12345-0@lo:101: Request processed in 184us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602352.331789:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787602352.331869:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853596800:0@lo:101: 00010000:00010000:0.0:1787602352.331880:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: 000000002c820132/0x3640686da09daee5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daeec expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.331887:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: 000000002c820132/0x3640686da09daee5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09daeec expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602352.331898:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787602352.331913:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: 000000002c820132/0x3640686da09daee5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daeec expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.331919:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: 000000002c820132/0x3640686da09daee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daeec expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602352.331924:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787602352.331928:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787602352.331933:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d3509288800 10000000:01000000:0.0:1787602352.331935:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787602352.331937:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787602352.331939:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787602352.331953:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: 00000000b12bb68a/0x3640686da09daef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.331959:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: 00000000b12bb68a/0x3640686da09daef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.331965:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: 00000000b12bb68a/0x3640686da09daef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602352.331993:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853596928:0@lo:101: 00000100:00100000:0.0:1787602352.332019:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.332053:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000429f6414 going to sleep for 11 seconds 00000100:00100000:0.0:1787602352.332067:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853596928 00000100:00100000:0.0:1787602352.332071:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853596928 00000100:00100000:0.0:1787602352.332089:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787602352.332095:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b224661 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+7:5818:x1874436853596928:12345-0@lo:101: 00010000:00010000:0.0:1787602352.332101:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602352.332107:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006135f913/0x3640686da09daefa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09daef3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.332118:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006135f913/0x3640686da09daefa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09daef3 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.332124:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006135f913/0x3640686da09daefa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09daef3 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.332129:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006135f913, rc 0) 00000100:00100000:0.0:1787602352.332156:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b224661 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+8:5818:x1874436853596928:12345-0@lo:101: Request processed in 61us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602352.332161:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787602352.332188:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853596928:0@lo:101: 00010000:00010000:0.0:1787602352.332196:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: 00000000b12bb68a/0x3640686da09daef3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daefa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.332201:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: 00000000b12bb68a/0x3640686da09daef3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09daefa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602352.332249:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853597056:0@lo:501: 00000100:00100000:0.0:1787602352.332271:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.332283:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000429f6414 going to sleep for 11 seconds 00000100:00100000:0.0:1787602352.332293:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853597056 00000100:00100000:0.0:1787602352.332296:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853597056 00000100:00100000:0.0:1787602352.332311:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787602352.332315:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbcf836c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+8:5818:x1874436853597056:12345-0@lo:501: 00000100:00100000:0.0:1787602352.332505:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbcf836c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+9:5818:x1874436853597056:12345-0@lo:501: Request processed in 189us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602352.332512:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787602352.332541:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853597056:0@lo:501: 00000100:00100000:0.0:1787602352.332565:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853597184:0@lo:503: 00000100:00100000:0.0:1787602352.332600:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.332768:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000429f6414 going to sleep for 11 seconds 00000100:00100000:0.0:1787602352.332782:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853597184 00000100:00100000:0.0:1787602352.332785:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853597184 00000100:00100000:0.0:1787602352.332801:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787602352.332806:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007403a5e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+9:5818:x1874436853597184:12345-0@lo:503: 00000100:00100000:0.0:1787602352.332942:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007403a5e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+9:5818:x1874436853597184:12345-0@lo:503: Request processed in 135us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602352.332949:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787602352.332998:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853597184:0@lo:503: 00000100:00100000:2.0:1787602352.333684:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008309b9db pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5859:1874436853597312:0@lo:502: 00000100:00100000:2.0:1787602352.333723:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.333922:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853597312 00000100:00100000:0.0:1787602352.333927:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853597312 00000100:00100000:1.0:1787602352.334022:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 000000009ab9b071 going to sleep for 11 seconds 00000100:00100000:3.0:1787602352.334183:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787602352.334191:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040700032 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+9:5859:x1874436853597312:12345-0@lo:502: 00000100:00100000:3.0:1787602352.334353:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040700032 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+9:5859:x1874436853597312:12345-0@lo:502: Request processed in 163us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602352.334360:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787602352.334424:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008309b9db pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5859:1874436853597312:0@lo:502: 00000020:01000000:0.0:1787602352.334448:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787602352.334459:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602352.334461:0:5859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787602352.334465:0:5859:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787602352.334467:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787602352.334487:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000083ac177b) 00000020:00000080:0.0:1787602352.334505:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787602352.334511:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787602352.334627:0:5859:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787602352.334635:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3640686da09daf08 00000020:00000080:0.0:1787602352.334855:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787602352.334860:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602352.334864:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602352.334865:0:5859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787602352.334868:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787602352.334871:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602352.334872:0:5859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787602352.334875:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787602352.334882:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000e3fb4900) 00000020:00000080:0.0:1787602352.334891:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787602352.334894:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787602352.334896:0:5859:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787602352.334898:0:5859:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787602352.334904:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787602352.334944:0:5859:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000029dc3802 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787602352.334956:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000059135cad) 00000020:00000080:0.0:1787602352.334963:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787602352.335045:0:5859:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787602352.335053:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3640686da09daf1d 00000020:00000080:0.0:1787602352.335144:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787602352.335151:0:5859:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787602352.335160:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3640686da09daf24 00080000:01000000:0.0:1787602352.335165:0:5859:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787602352.335168:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3640686da09daf2b 00080000:10000000:0.0:1787602352.335565:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787602352.335808:0:5859:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787602352.342932:0:5859:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787602352.427575:0:5859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787602352.428247:0:5859:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787602352.431098:0:5859:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787602352.431437:0:5859:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787602352.485770:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a19792c8) 00000020:00000080:1.0:1787602352.485796:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787602352.485860:0:5859:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787602352.485877:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3640686da09daf39 00000020:00000080:1.0:1787602352.486291:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787602352.488364:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787602352.536003:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787602352.574262:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602352.606016:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602352.651259:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787602352.683365:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1787602352.715216:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3640686da09daf40 00000020:00000080:2.0:1787602352.715585:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787602352.715595:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602352.715601:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602352.715603:0:5859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787602352.715606:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602352.715609:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602352.715610:0:5859:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787602352.715613:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787602352.715614:0:5859:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787602352.715616:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602352.715619:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602352.715620:0:5859:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787602352.715621:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602352.715625:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602352.715631:0:5859:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787602352.715635:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787602352.715670:0:5859:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1787602352.715817:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b5d7bb6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5859:1874436853597440:0@lo:502: 00000100:00100000:2.0:1787602352.715897:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602352.715945:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a20199e4 going to sleep for 11 seconds 00000100:00100000:1.0:1787602352.716010:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853597440 00000100:00100000:1.0:1787602352.716018:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853597440 00000100:00100000:1.0:1787602352.716071:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787602352.716079:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000333427e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+9:5859:x1874436853597440:12345-0@lo:502: 00000100:00100000:1.0:1787602352.716388:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000333427e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+9:5859:x1874436853597440:12345-0@lo:502: Request processed in 310us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602352.716400:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787602352.716611:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b5d7bb6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5859:1874436853597440:0@lo:502: 00000020:01000000:2.0:1787602352.716638:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602352.716643:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602352.716645:0:5859:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787602352.716649:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787602352.716938:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787602352.716958:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787602352.716985:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: 00000000b12bb68a/0x3640686da09daef3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daefa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602352.716995:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: 00000000b12bb68a/0x3640686da09daef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daefa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602352.717003:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d3509288800 from 1 10000000:01000000:1.0:1787602352.717006:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787602352.717104:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: 0000000010e1adf2/0x3640686da09daf47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602352.717112:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: 0000000010e1adf2/0x3640686da09daf47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602352.717119:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: 0000000010e1adf2/0x3640686da09daf47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602352.717134:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a9f1679 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853597568:0@lo:101: 00000100:00100000:1.0:1787602352.717170:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602352.717244:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a9d3939 going to sleep for 11 seconds 00000100:00100000:3.0:1787602352.717372:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853597568 00000100:00100000:3.0:1787602352.717379:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853597568 00000100:00100000:3.0:1787602352.717448:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787602352.717457:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5b845a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+9:5818:x1874436853597568:12345-0@lo:101: 00010000:00010000:3.0:1787602352.717469:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602352.717481:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000011057033/0x3640686da09daf4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09daf47 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.717501:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011057033/0x3640686da09daf4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09daf47 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.717509:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000011057033/0x3640686da09daf4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09daf47 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.717517:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000011057033, rc 0) 00000100:00100000:3.0:1787602352.717562:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5b845a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+10:5818:x1874436853597568:12345-0@lo:101: Request processed in 108us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602352.717568:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787602352.717632:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a9f1679 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853597568:0@lo:101: 00010000:00010000:0.0:1787602352.717643:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: 0000000010e1adf2/0x3640686da09daf47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daf4e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.717652:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: 0000000010e1adf2/0x3640686da09daf47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09daf4e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602352.718220:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853597696:0@lo:256: 00000100:00100000:0.0:1787602352.718262:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.718988:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e79f5bc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602352.719113:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853597696 00000100:00100000:1.0:1787602352.719121:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853597696 00000100:00100000:1.0:1787602352.719157:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787602352.719164:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5cb5743 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+10:5818:x1874436853597696:12345-0@lo:256: 20000000:01000000:1.0:1787602352.719184:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787602352.719190:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787602352.719289:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5cb5743 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+10:5818:x1874436853597696:12345-0@lo:256: Request processed in 126us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602352.719297:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787602352.719387:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853597696:0@lo:256: 10000000:01000000:0.0:1787602352.720013:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787602352.720028:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: 0000000010e1adf2/0x3640686da09daf47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daf4e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.720163:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: 0000000010e1adf2/0x3640686da09daf47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daf4e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602352.720171:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3509288800 from 1 10000000:01000000:0.0:1787602352.720174:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602352.720205:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: 0000000037b898d9/0x3640686da09daf55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.720223:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: 0000000037b898d9/0x3640686da09daf55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.720231:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: 0000000037b898d9/0x3640686da09daf55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602352.720249:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853597824:0@lo:101: 00000100:00100000:0.0:1787602352.720288:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.720307:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e79f5bc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602352.720411:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853597824 00000100:00100000:1.0:1787602352.720416:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853597824 00000100:00100000:1.0:1787602352.720442:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787602352.720447:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f6724dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+10:5818:x1874436853597824:12345-0@lo:101: 00010000:00010000:1.0:1787602352.720457:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602352.720471:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b8fea097/0x3640686da09daf5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09daf55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602352.720488:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b8fea097/0x3640686da09daf5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09daf55 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602352.720498:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b8fea097/0x3640686da09daf5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09daf55 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602352.720506:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b8fea097, rc 0) 00000100:00100000:1.0:1787602352.720537:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f6724dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:5818:x1874436853597824:12345-0@lo:101: Request processed in 89us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602352.720542:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787602352.720634:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853597824:0@lo:101: 00010000:00010000:0.0:1787602352.720645:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: 0000000037b898d9/0x3640686da09daf55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daf5c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.720652:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: 0000000037b898d9/0x3640686da09daf55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09daf5c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602352.720699:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853597952:0@lo:501: 00000100:00100000:0.0:1787602352.720819:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.720838:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e79f5bc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602352.720891:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853597952 00000100:00100000:1.0:1787602352.720895:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853597952 00000100:00100000:1.0:1787602352.720913:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787602352.720918:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba140bc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:5818:x1874436853597952:12345-0@lo:501: 00000100:00100000:1.0:1787602352.721591:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba140bc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:5818:x1874436853597952:12345-0@lo:501: Request processed in 672us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602352.721599:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787602352.721863:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853597952:0@lo:501: 00000100:00100000:0.0:1787602352.721900:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853598080:0@lo:503: 00000100:00100000:0.0:1787602352.721942:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.721975:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e79f5bc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602352.722024:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853598080 00000100:00100000:1.0:1787602352.722107:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853598080 00000100:00100000:1.0:1787602352.722133:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787602352.722140:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2cdf71d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:5818:x1874436853598080:12345-0@lo:503: 00000040:00080000:1.0:1787602352.722177:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787602352.722225:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2cdf71d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:5818:x1874436853598080:12345-0@lo:503: Request processed in 85us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602352.722231:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787602352.722310:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853598080:0@lo:503: 00000040:00080000:1.0:1787602352.723537:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787602352.724379:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787602352.724420:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602352.724480:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: 0000000037b898d9/0x3640686da09daf55 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daf5c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.724494:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: 0000000037b898d9/0x3640686da09daf55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daf5c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602352.724597:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787602352.724601:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d3509288800 10000000:01000000:2.0:1787602352.724605:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d3509288800 10000000:01000000:2.0:1787602352.724610:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787602352.724617:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3509288800 from 1 10000000:01000000:2.0:1787602352.724620:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787602352.724665:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: 000000003450de46/0x3640686da09daf63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602352.724672:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: 000000003450de46/0x3640686da09daf63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602352.724682:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: 000000003450de46/0x3640686da09daf63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602352.724702:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b5d7bb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853598208:0@lo:101: 00000100:00100000:2.0:1787602352.724822:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602352.724858:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000078e5814f going to sleep for 11 seconds 00000100:00100000:3.0:1787602352.724998:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853598208 00000100:00100000:3.0:1787602352.725007:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853598208 00000100:00100000:3.0:1787602352.725058:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787602352.725068:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac99157c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:5818:x1874436853598208:12345-0@lo:101: 00010000:00010000:3.0:1787602352.725079:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602352.725092:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df1fb0a2/0x3640686da09daf6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09daf63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.725116:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df1fb0a2/0x3640686da09daf6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09daf63 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.725138:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df1fb0a2/0x3640686da09daf6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09daf63 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.725147:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df1fb0a2, rc 0) 00000100:00100000:3.0:1787602352.725192:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac99157c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5818:x1874436853598208:12345-0@lo:101: Request processed in 126us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602352.725199:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787602352.725572:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b5d7bb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853598208:0@lo:101: 00010000:00010000:2.0:1787602352.725597:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: 000000003450de46/0x3640686da09daf63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daf6a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602352.725605:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: 000000003450de46/0x3640686da09daf63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09daf6a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602352.725659:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b5d7bb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853598336:0@lo:501: 00000100:00100000:2.0:1787602352.725690:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602352.725723:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000078e5814f going to sleep for 11 seconds 00000100:00100000:3.0:1787602352.725867:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853598336 00000100:00100000:3.0:1787602352.725872:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853598336 00000100:00100000:3.0:1787602352.725902:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787602352.725909:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dba5d3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5818:x1874436853598336:12345-0@lo:501: 00000100:00100000:3.0:1787602352.726257:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dba5d3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5818:x1874436853598336:12345-0@lo:501: Request processed in 348us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602352.726264:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787602352.726334:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b5d7bb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853598336:0@lo:501: 00000100:00100000:2.0:1787602352.726363:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b5d7bb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853598464:0@lo:503: 00000100:00100000:2.0:1787602352.726399:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602352.726428:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000078e5814f going to sleep for 11 seconds 00000100:00100000:0.0:1787602352.726479:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853598464 00000100:00100000:0.0:1787602352.726485:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853598464 00000100:00100000:0.0:1787602352.726513:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787602352.726518:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac332770 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5818:x1874436853598464:12345-0@lo:503: 00000100:00100000:0.0:1787602352.726853:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac332770 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5818:x1874436853598464:12345-0@lo:503: Request processed in 334us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602352.726859:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787602352.727013:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b5d7bb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853598464:0@lo:503: 00000100:00100000:2.0:1787602352.727485:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ab4bfb6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5864:1874436853598592:0@lo:502: 00000100:00100000:2.0:1787602352.727540:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602352.727571:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bcac2cab going to sleep for 11 seconds 00000100:00100000:3.0:1787602352.727952:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853598592 00000100:00100000:3.0:1787602352.727959:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853598592 00000100:00100000:0.0:1787602352.728540:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787602352.728551:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3c4b024 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5864:x1874436853598592:12345-0@lo:502: 00000100:00100000:0.0:1787602352.728883:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3c4b024 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5864:x1874436853598592:12345-0@lo:502: Request processed in 335us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602352.728891:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787602352.729474:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ab4bfb6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5864:1874436853598592:0@lo:502: 00000020:01000004:2.0:1787602352.729552:0:5864:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787602352.729570:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c726ddaa) 00000020:00000080:2.0:1787602352.729592:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787602352.729682:0:5864:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000029dc3802 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787602352.729687:0:5864:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000029dc3802 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787602352.729689:0:5864:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000029dc3802 4 00010000:00080000:2.0:1787602352.729807:0:5864:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000992c5c8f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.126@tcp at head 00010000:00010000:2.0:1787602352.732475:0:5864:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787602352.732667:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787602352.732702:0:5864:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787602352.733191:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3640686da09daf78 00000100:00080000:2.0:1787602352.733201:0:5864:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787602352.733206:0:5864:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000992c5c8f using connection 192.168.201.126@tcp/0@lo 00000100:00100000:2.0:1787602352.733239:0:5864:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003ab4bfb6 x1874436853598720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787602352.733301:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ab4bfb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874436853598720:0@lo:38: 00000100:00100000:1.0:1787602352.733368:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787602352.733441:0:5864:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787602352.737989:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008b997db9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5864:1874436853598848:0@lo:502: 00000100:00100000:2.0:1787602352.738090:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602352.738145:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853598848 00000100:00100000:2.0:1787602352.738152:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853598848 00000100:00100000:2.0:1787602352.738195:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787602352.738204:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bdedde0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5864:x1874436853598848:12345-0@lo:502: 00000100:00100000:2.0:1787602352.738419:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bdedde0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5864:x1874436853598848:12345-0@lo:502: Request processed in 216us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602352.738427:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787602352.738538:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a1fd847b going to sleep for 11 seconds 00000100:00100000:2.0:1787602352.738558:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008b997db9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5864:1874436853598848:0@lo:502: 00000040:00080000:2.0:1787602352.738586:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787602352.738866:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787602352.738886:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787602352.738906:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: 000000003450de46/0x3640686da09daf63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daf6a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602352.738916:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: 000000003450de46/0x3640686da09daf63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daf6a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787602352.738972:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787602352.738979:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787602352.738980:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602352.738981:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602352.738982:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602352.738983:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602352.738985:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787602352.738986:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787602352.738987:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787602352.738988:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787602352.738989:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602352.738991:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787602352.738994:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787602352.738997:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787602352.738998:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787602352.738999:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602352.739000:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602352.739001:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602352.739002:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602352.739003:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787602352.739004:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787602352.739004:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787602352.739005:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787602352.739006:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602352.739007:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787602352.739021:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787602352.739092:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008b997db9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853598976:0@lo:253: 00000100:00100000:2.0:1787602352.739128:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602352.739151:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a20199e4 going to sleep for 11 seconds 00000100:00100000:2.0:1787602352.739167:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853598976 00000100:00100000:2.0:1787602352.739171:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853598976 00000100:00100000:2.0:1787602352.739196:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787602352.739204:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000978f25c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5818:x1874436853598976:12345-0@lo:253: 20000000:01000000:2.0:1787602352.739241:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787602352.739256:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787602352.740413:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853598720 00000100:00100000:0.0:1787602352.740426:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853598720 00000100:00100000:0.0:1787602352.740458:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602352.740464:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e610255 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1874436853598720:12345-0@lo:38: 00000100:00100000:0.0:1787602352.749210:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e610255 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1874436853598720:12345-0@lo:38: Request processed in 8735us (15833us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787602352.749226:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787602352.752600:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787602352.752611:0:3300:0:(import.c:65:import_set_state_nolock()) 00000000992c5c8f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787602352.752618:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787602352.752622:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ab4bfb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874436853598720:0@lo:38: 20000000:01000000:2.0:1787602352.782445:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787602352.782468:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787602352.782538:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787602352.782543:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787602352.782578:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000273f4556/0x3640686da09daf7f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.782595:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000011057033/0x3640686da09daf4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09daf47 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.782603:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000273f4556/0x3640686da09daf7f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.782647:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000011057033/0x3640686da09daf4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09daf47 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.782662:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000011057033/0x3640686da09daf4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09daf47 expref: 12 pid: 5831 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602352.782677:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874436853599104:0@lo:104: 00000100:00100000:0.0:1787602352.782778:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602352.782834:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009480611 going to sleep for 11 seconds 00000100:00100000:1.0:1787602352.783118:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853599104 00000100:00100000:1.0:1787602352.783127:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853599104 00000100:00100000:1.0:1787602352.783213:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787602352.783221:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035b2a610 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:5852:x1874436853599104:12345-0@lo:104: 00010000:00010000:1.0:1787602352.783233:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: 0000000010e1adf2/0x3640686da09daf47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09daf4e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602352.783299:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602352.783304:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035b2a610 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:5852:x1874436853599104:12345-0@lo:104: Request processed in 85us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602352.783310:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787602352.783355:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602352.783361:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: 0000000010e1adf2/0x3640686da09daf47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09daf4e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.783368:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000010e1adf2 already unused, calling callback (00000000554fbece) 10000000:00010000:3.0:1787602352.783371:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: 0000000010e1adf2/0x3640686da09daf47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09daf4e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.783380:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: 0000000010e1adf2/0x3640686da09daf47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09daf4e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602352.783400:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: 0000000010e1adf2/0x3640686da09daf47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09daf4e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602352.783404:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787602352.783447:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: 0000000010e1adf2/0x3640686da09daf47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daf4e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.783454:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602352.783471:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: 0000000010e1adf2/0x3640686da09daf47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daf4e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.783476:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: 0000000010e1adf2/0x3640686da09daf47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daf4e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.783496:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602352.783497:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602352.783498:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602352.783562:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c588e465 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853599232:0@lo:103: 00000100:00100000:3.0:1787602352.783596:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602352.783676:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853599232 00000100:00100000:3.0:1787602352.783680:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853599232 00010000:00010000:3.0:1787602352.783700:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000011057033/0x3640686da09daf4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09daf47 expref: 13 pid: 5831 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602352.783737:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787602352.783773:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000212d73d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:3302:x1874436853599232:12345-0@lo:103: 00010000:00010000:3.0:1787602352.783795:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602352.783800:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000011057033/0x3640686da09daf4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09daf47 expref: 13 pid: 5831 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.783813:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000011057033/0x3640686da09daf4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09daf47 expref: 13 pid: 5831 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.783829:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000273f4556/0x3640686da09daf7f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.783835:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000273f4556/0x3640686da09daf7f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787602352.783848:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001306066s 00010000:00010000:3.0:1787602352.783851:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000273f4556/0x3640686da09daf7f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.783857:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000273f4556/0x3640686da09daf7f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.783863:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000273f4556/0x3640686da09daf7f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.783868:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000273f4556/0x3640686da09daf7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.783872:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000273f4556 already unused, calling callback (0000000030ed8008) 00010000:00010000:3.0:1787602352.783875:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000273f4556/0x3640686da09daf7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.783881:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000273f4556/0x3640686da09daf7f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.783887:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000273f4556/0x3640686da09daf7f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602352.783904:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602352.783931:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000212d73d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:3302:x1874436853599232:12345-0@lo:103: Request processed in 189us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602352.783937:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787602352.783993:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c588e465 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853599232:0@lo:103: 00010000:00010000:0.0:1787602352.784143:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000011057033/0x3640686da09daf4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09daf47 expref: 12 pid: 5831 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602352.784156:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874436853599104:0@lo:104: 00010000:00010000:0.0:1787602352.784169:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000273f4556/0x3640686da09daf7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.784177:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000273f4556/0x3640686da09daf7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.784182:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000273f4556/0x3640686da09daf7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602352.784197:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000273f4556/0x3640686da09daf7f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602352.795357:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000978f25c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:5818:x1874436853598976:12345-0@lo:253: Request processed in 56145us (56220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602352.795374:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787602352.795486:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008b997db9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5818:1874436853598976:0@lo:253: 10000000:01000000:2.0:1787602352.795518:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787602352.795521:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787602352.795523:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787602352.795524:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602352.795525:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602352.795527:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602352.795528:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602352.795529:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787602352.795531:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787602352.795532:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787602352.795534:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787602352.795535:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602352.795537:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787602352.795556:0:5818:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787602352.801928:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602352.802501:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787602352.802900:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602352.803311:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787602352.803512:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602352.803687:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787602352.804563:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602352.804892:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787602352.805231:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602352.805421:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787602352.805617:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602352.805910:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:1.0:1787602352.813918:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:0.0:1787602352.860334:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1787602352.909554:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787602352.909991:0:5870:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1787602352.911233:0:5869:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787602352.911245:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787602352.918316:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787602352.918622:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787602352.919581:0:5818:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787602352.919593:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787602352.919911:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787602352.921126:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787602352.921910:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787602352.921976:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787602352.922523:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787602352.930879:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787602352.933277:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787602352.933444:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787602352.933568:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787602352.933711:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787602352.933900:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787602352.934065:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787602352.934207:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787602352.934362:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787602352.934513:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787602352.934659:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787602352.934837:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787602352.942778:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787602352.943051:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787602352.943234:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787602352.945890:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787602352.950473:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787602352.951652:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787602352.951842:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787602352.952004:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787602352.952182:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787602352.952338:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787602352.952481:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787602352.952625:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787602352.952805:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787602352.952938:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787602352.956135:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787602352.956969:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787602352.959274:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787602352.963535:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787602352.965479:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787602352.965680:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787602352.965893:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787602352.966092:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787602352.998694:0:5870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787602353.100279:0:5818:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787602353.100318:0:5818:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffad9941c5f988 00100000:10000000:2.0:1787602353.100326:0:5818:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787602353.120091:0:5818:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787602353.120113:0:5818:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787602353.120122:0:5818:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787602353.120155:0:5818:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1787602353.185501:0:5870:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787602353.185582:0:5870:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1787602353.185587:0:5870:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787602353.864306:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602354.861037:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602355.890929:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602356.909186:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787602357.869867:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787602357.869886:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787602357.869889:0:8:0:(import.c:65:import_set_state_nolock()) 00000000992c5c8f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787602357.869902:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000992c5c8f using connection 192.168.201.126@tcp/0@lo 00000100:00100000:2.0:1787602357.869923:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f41f7622 x1874436853599488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787602357.869967:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f41f7622 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874436853599488:0@lo:38: 00000100:00100000:1.0:1787602357.870010:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008b997db9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853599360:0@lo:400: 00000100:00100000:2.0:1787602357.870050:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602357.870050:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602357.870114:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853599360 00000100:00100000:0.0:1787602357.870124:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853599360 00000100:00100000:0.0:1787602357.870180:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787602357.870189:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2d224c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:3303:x1874436853599360:12345-0@lo:400: 00000100:00100000:0.0:1787602357.870243:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2d224c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:3303:x1874436853599360:12345-0@lo:400: Request processed in 55us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602357.870250:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787602357.870296:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853599488 00000100:00100000:0.0:1787602357.870301:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853599488 00000100:00100000:0.0:1787602357.870326:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602357.870331:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b8a2a1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3300:x1874436853599488:12345-0@lo:38: 00010000:00080000:0.0:1787602357.870355:0:5838:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:0.0:1787602357.870390:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3640686da09daf86 00000004:00100000:0.0:1787602357.870443:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787602357.870570:0:5838:0:(import.c:65:import_set_state_nolock()) 00000000891153b0 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787602357.870620:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b8a2a1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874436853599488:12345-0@lo:38: Request processed in 287us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602357.870627:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602357.872407:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008b997db9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853599360:0@lo:400: 00010000:00080000:3.0:1787602357.875246:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f41f7622 x1874436853599488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787602367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787602357.875271:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787602357.875280:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787602357.875286:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787602357.875289:0:3300:0:(import.c:65:import_set_state_nolock()) 00000000992c5c8f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787602357.875296:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f41f7622 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874436853599488:0@lo:38: 00010000:00010000:3.0:1787602357.935332:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787602357.951119:0:6113:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787602358.977302:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602359.988886:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602361.004871:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787602361.453851:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787602361.453860:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d3509288800 from 3 10000000:01000000:3.0:1787602361.453864:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787602361.453924:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: 00000000193ad427/0x3640686da09daf8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.453937:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: 00000000193ad427/0x3640686da09daf8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.453961:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: 00000000193ad427/0x3640686da09daf8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602361.453995:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c588e465 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853599616:0@lo:101: 00000100:00100000:3.0:1787602361.454069:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.454118:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f2c186cb going to sleep for 11 seconds 00000100:00100000:0.0:1787602361.454242:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853599616 00000100:00100000:0.0:1787602361.454251:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853599616 00000100:00100000:0.0:1787602361.454319:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787602361.454328:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4ec743a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:5834:x1874436853599616:12345-0@lo:101: 00010000:00010000:0.0:1787602361.454343:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602361.454360:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f543a2ed/0x3640686da09daf94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09daf8d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.454385:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f543a2ed/0x3640686da09daf94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09daf8d expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.454395:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f543a2ed/0x3640686da09daf94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09daf8d expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602361.454404:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f543a2ed, rc 0) 00000100:00100000:0.0:1787602361.454455:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4ec743a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5834:x1874436853599616:12345-0@lo:101: Request processed in 128us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602361.454462:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787602361.457298:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c588e465 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853599616:0@lo:101: 00010000:00010000:3.0:1787602361.457327:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: 00000000193ad427/0x3640686da09daf8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daf94 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.457338:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: 00000000193ad427/0x3640686da09daf8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09daf94 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602361.457409:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c588e465 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853599744:0@lo:256: 00000100:00100000:3.0:1787602361.457479:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602361.457524:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f2c186cb going to sleep for 11 seconds 00000100:00100000:0.0:1787602361.457546:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853599744 00000100:00100000:0.0:1787602361.457553:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853599744 00000100:00100000:0.0:1787602361.457603:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787602361.457613:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb3da722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5834:x1874436853599744:12345-0@lo:256: 20000000:01000000:0.0:1787602361.457632:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787602361.457649:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787602361.457657:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787602361.457738:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb3da722 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5834:x1874436853599744:12345-0@lo:256: Request processed in 126us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602361.457762:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787602361.457844:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c588e465 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853599744:0@lo:256: 10000000:01000000:3.0:1787602361.457892:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787602361.457898:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: 00000000193ad427/0x3640686da09daf8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daf94 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602361.457906:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: 00000000193ad427/0x3640686da09daf8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daf94 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602362.033565:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602362.989161:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602362.989187:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2ef544d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853599872:0@lo:400: 00000100:00100000:2.0:1787602362.989276:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602362.989340:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000833453d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853600000:0@lo:400: 00000100:00100000:2.0:1787602362.989368:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602362.989403:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853599872 00000100:00100000:2.0:1787602362.989410:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853599872 00000100:00100000:2.0:1787602362.989453:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787602362.989462:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbbd8ccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:3303:x1874436853599872:12345-0@lo:400: 00000100:00100000:2.0:1787602362.989509:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbbd8ccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:3303:x1874436853599872:12345-0@lo:400: Request processed in 49us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602362.989516:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787602362.989558:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2ef544d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853599872:0@lo:400: 00000100:00100000:0.0:1787602362.991191:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853600000 00000100:00100000:0.0:1787602362.991210:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853600000 00000100:00100000:0.0:1787602362.991275:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602362.991290:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe7b9048 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853600000:12345-0@lo:400: 00000100:00100000:0.0:1787602362.991393:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe7b9048 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853600000:12345-0@lo:400: Request processed in 105us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602362.991401:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787602362.991550:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000833453d8 x1874436853600000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602362.991566:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000833453d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853600000:0@lo:400: 00010000:00010000:1.0:1787602363.053340:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787602363.309246:0:6315:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8d3f4d10 20000000:00000080:2.0:1787602363.309263:0:6315:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d3502fa9000 uarg=0000000000000000 20000000:01000000:2.0:1787602363.309298:0:6315:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787602363.309304:0:6315:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787602363.309309:0:6315:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787602363.309607:0:6315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787602363.309622:0:6315:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787602363.319091:0:6315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787602363.319330:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787602363.319388:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787602363.319440:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787602363.319461:0:6315:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787602363.319478:0:6315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009426c247/0x3640686da09daf9b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602363.319498:0:6315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b8fea097/0x3640686da09daf5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09daf55 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602363.319518:0:6315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009426c247/0x3640686da09daf9b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602363.319559:0:6315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b8fea097/0x3640686da09daf5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09daf55 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602363.319575:0:6315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b8fea097/0x3640686da09daf5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09daf55 expref: 11 pid: 5829 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602363.319589:0:6315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2ef544d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6315:1874436853600128:0@lo:104: 00000100:00100000:2.0:1787602363.319656:0:6315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602363.319731:0:6315:0:(client.c:2715:ptlrpc_set_wait()) set 00000000216cd3a4 going to sleep for 11 seconds 00000100:00100000:1.0:1787602363.322853:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853600128 00000100:00100000:1.0:1787602363.322876:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853600128 00000100:00100000:1.0:1787602363.322952:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602363.322964:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ae1b6fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:6315:x1874436853600128:12345-0@lo:104: 00010000:00010000:1.0:1787602363.322984:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: 0000000037b898d9/0x3640686da09daf55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09daf5c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602363.323098:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602363.323113:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ae1b6fb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:6315:x1874436853600128:12345-0@lo:104: Request processed in 152us (3458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602363.323120:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787602363.323201:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602363.323224:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: 0000000037b898d9/0x3640686da09daf55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09daf5c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.323231:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000037b898d9 already unused, calling callback (00000000554fbece) 10000000:00010000:3.0:1787602363.323234:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: 0000000037b898d9/0x3640686da09daf55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09daf5c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.323241:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: 0000000037b898d9/0x3640686da09daf55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09daf5c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602363.323247:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: 0000000037b898d9/0x3640686da09daf55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09daf5c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602363.323253:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787602363.323303:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: 0000000037b898d9/0x3640686da09daf55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daf5c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.323310:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602363.323339:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: 0000000037b898d9/0x3640686da09daf55 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daf5c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.323345:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: 0000000037b898d9/0x3640686da09daf55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daf5c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.323366:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602363.323367:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602363.323369:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602363.323873:0:6315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2ef544d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6315:1874436853600128:0@lo:104: 00010000:00010000:2.0:1787602363.323901:0:6315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009426c247/0x3640686da09daf9b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602363.324064:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c588e465 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853600256:0@lo:103: 00000100:00100000:1.0:1787602363.324113:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602363.324211:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853600256 00000100:00100000:3.0:1787602363.324219:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853600256 00010000:00010000:3.0:1787602363.324252:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b8fea097/0x3640686da09daf5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09daf55 expref: 12 pid: 5829 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602363.324299:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787602363.324307:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ab5c921 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:3302:x1874436853600256:12345-0@lo:103: 00010000:00010000:3.0:1787602363.324321:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602363.324326:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b8fea097/0x3640686da09daf5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09daf55 expref: 12 pid: 5829 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.324337:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b8fea097/0x3640686da09daf5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09daf55 expref: 12 pid: 5829 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.324352:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b8fea097/0x3640686da09daf5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09daf55 expref: 12 pid: 5829 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.324367:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009426c247/0x3640686da09daf9b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.324373:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009426c247/0x3640686da09daf9b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.324387:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009426c247/0x3640686da09daf9b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.324393:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009426c247/0x3640686da09daf9b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.324398:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009426c247/0x3640686da09daf9b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.324403:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009426c247/0x3640686da09daf9b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.324418:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009426c247 already unused, calling callback (0000000030ed8008) 00010000:00010000:3.0:1787602363.324421:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009426c247/0x3640686da09daf9b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.324426:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009426c247/0x3640686da09daf9b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.324446:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009426c247/0x3640686da09daf9b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602363.324456:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602363.324500:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ab5c921 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:3302:x1874436853600256:12345-0@lo:103: Request processed in 194us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602363.324507:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787602363.324605:0:6315:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009426c247/0x3640686da09daf9b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602363.324613:0:6315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009426c247/0x3640686da09daf9b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602363.324619:0:6315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009426c247/0x3640686da09daf9b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602363.325807:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c588e465 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853600256:0@lo:103: 00010000:00010000:1.0:1787602364.077000:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602365.101371:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602366.125573:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602367.149107:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602368.112122:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853600384:0@lo:400: 00000100:00100000:2.0:1787602368.112203:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602368.115467:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602368.115488:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d0efa8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853600512:0@lo:400: 00000100:00100000:2.0:1787602368.115589:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602368.115663:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853600384 00000100:00100000:2.0:1787602368.115672:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853600384 00000100:00100000:2.0:1787602368.115728:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787602368.115737:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000559e3b75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:3303:x1874436853600384:12345-0@lo:400: 00000100:00100000:2.0:1787602368.115811:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000559e3b75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:3303:x1874436853600384:12345-0@lo:400: Request processed in 75us (3608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602368.115819:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787602368.115861:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853600512 00000100:00100000:2.0:1787602368.115865:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853600512 00000100:00100000:2.0:1787602368.115895:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602368.115901:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2ef544d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853600512:12345-0@lo:400: 00000100:00100000:2.0:1787602368.115934:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2ef544d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853600512:12345-0@lo:400: Request processed in 34us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602368.115941:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787602368.115987:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002d0efa8a x1874436853600512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602368.118511:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d0efa8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853600512:0@lo:400: 00000100:00100000:2.0:1787602368.118540:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000783b71f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853600384:0@lo:400: 00010000:00010000:2.0:1787602368.176312:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787602368.620941:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787602368.620950:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3509288800 from 1 10000000:01000000:0.0:1787602368.620954:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602368.621015:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: 00000000144d5ce7/0x3640686da09dafa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602368.621027:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: 00000000144d5ce7/0x3640686da09dafa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602368.621039:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: 00000000144d5ce7/0x3640686da09dafa2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602368.621065:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000857377c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853600640:0@lo:101: 00000100:00100000:0.0:1787602368.621134:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602368.621205:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c532add going to sleep for 11 seconds 00000100:00100000:1.0:1787602368.621289:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853600640 00000100:00100000:1.0:1787602368.621298:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853600640 00000100:00100000:1.0:1787602368.621346:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787602368.621354:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1f7c291 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:5834:x1874436853600640:12345-0@lo:101: 00010000:00010000:1.0:1787602368.621366:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602368.621381:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003fb85274/0x3640686da09dafa9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dafa2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602368.621414:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003fb85274/0x3640686da09dafa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dafa2 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602368.621424:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003fb85274/0x3640686da09dafa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dafa2 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602368.621433:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003fb85274, rc 0) 00000100:00100000:1.0:1787602368.621477:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1f7c291 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5834:x1874436853600640:12345-0@lo:101: Request processed in 124us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602368.621484:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787602368.621633:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000857377c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853600640:0@lo:101: 00010000:00010000:0.0:1787602368.621647:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: 00000000144d5ce7/0x3640686da09dafa2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dafa9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602368.621666:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: 00000000144d5ce7/0x3640686da09dafa2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dafa9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602368.621728:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000857377c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853600768:0@lo:501: 00000100:00100000:0.0:1787602368.621781:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602368.621795:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c532add going to sleep for 11 seconds 00000100:00100000:1.0:1787602368.621934:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853600768 00000100:00100000:1.0:1787602368.621938:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853600768 00000100:00100000:1.0:1787602368.621969:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787602368.621976:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001330c867 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5834:x1874436853600768:12345-0@lo:501: 00000100:00100000:1.0:1787602368.622223:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001330c867 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5834:x1874436853600768:12345-0@lo:501: Request processed in 248us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602368.622230:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787602368.622945:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000857377c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853600768:0@lo:501: 00000100:00100000:1.0:1787602368.622981:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0cc8dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853600896:0@lo:503: 00000100:00100000:1.0:1787602368.623030:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602368.623061:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000000c212e8c going to sleep for 11 seconds 00000100:00100000:1.0:1787602368.623076:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853600896 00000100:00100000:1.0:1787602368.623080:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853600896 00000100:00100000:1.0:1787602368.623104:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787602368.623110:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070f254c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5834:x1874436853600896:12345-0@lo:503: 00000100:00100000:1.0:1787602368.623293:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070f254c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5834:x1874436853600896:12345-0@lo:503: Request processed in 182us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602368.623300:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787602368.623343:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0cc8dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853600896:0@lo:503: 00000100:00100000:1.0:1787602368.623682:0:6603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0cc8dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6603:1874436853601024:0@lo:502: 00000100:00100000:1.0:1787602368.623730:0:6603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602368.623778:0:6603:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d16a90f going to sleep for 11 seconds 00000100:00100000:2.0:1787602368.625815:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853601024 00000100:00100000:2.0:1787602368.625831:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853601024 00000100:00100000:2.0:1787602368.625892:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787602368.625902:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5e30823 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6603:x1874436853601024:12345-0@lo:502: 00000100:00100000:2.0:1787602368.626219:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5e30823 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6603:x1874436853601024:12345-0@lo:502: Request processed in 318us (2489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602368.626238:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787602368.626960:0:6603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0cc8dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6603:1874436853601024:0@lo:502: 00000020:01000000:1.0:1787602368.626999:0:6603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787602368.627010:0:6603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602368.627013:0:6603:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787602368.627021:0:6603:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3509288800 00000020:00000080:1.0:1787602368.627023:0:6603:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787602368.627083:0:6603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6603:1874436853601152:0@lo:502: 00000100:00100000:1.0:1787602368.627137:0:6603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602368.627179:0:6603:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3504a34840 going to sleep for 11 seconds 00000100:00100000:2.0:1787602368.627362:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853601152 00000100:00100000:2.0:1787602368.627369:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853601152 00000100:00100000:2.0:1787602368.627400:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787602368.627409:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6603:x1874436853601152:12345-0@lo:502: 00000100:00100000:2.0:1787602368.628206:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6603:x1874436853601152:12345-0@lo:502: Request processed in 794us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602368.628216:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787602368.628809:0:6603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6603:1874436853601152:0@lo:502: 00000020:01000000:1.0:1787602368.628844:0:6603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602368.628851:0:6603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602368.628853:0:6603:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787602368.628858:0:6603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787602368.631919:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787602368.631951:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787602368.631963:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09dafa2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dafa9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602368.631977:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09dafa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dafa9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602369.197974:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602370.222117:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787602370.696415:0:6685:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787602370.696419:0:6685:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787602370.696557:0:6685:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d353d79c800 00000020:01000004:2.0:1787602370.696573:0:6685:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787602370.696586:0:6685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787602370.696600:0:6685:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d35035c0000) 00000020:00000080:2.0:1787602370.696616:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787602370.737982:0:6685:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787602370.738289:0:6685:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787602370.778634:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787602370.789633:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787602370.793546:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787602370.795327:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787602370.795381:0:6685:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787602370.797358:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787602370.797373:0:6685:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787602370.797430:0:6685:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3640686da09dafb7 00000020:01000004:2.0:1787602370.797441:0:6685:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787602370.797465:0:6685:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787602370.797469:0:6685:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787602370.797476:0:6685:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787602370.797480:0:6685:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787602370.797494:0:6685:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d35035c3370) 00000020:00000080:2.0:1787602370.797505:0:6685:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1787602370.808254:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787602370.808450:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787602370.808456:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787602370.809979:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787602370.809991:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787602370.810274:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787602370.810280:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787602370.814982:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787602370.815181:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787602370.815187:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787602370.816692:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787602370.816702:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787602370.860588:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787602370.860891:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787602370.860898:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787602370.864898:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787602370.864918:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787602370.867016:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787602370.867031:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787602370.869885:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787602370.870117:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787602370.870124:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787602370.871707:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787602370.871953:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787602370.993053:0:6685:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787602370.993515:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787602370.993523:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787602371.008696:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787602371.008912:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787602371.014472:0:6685:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787602371.014516:0:6685:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787602371.014523:0:6685:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787602371.068143:0:6685:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787602371.068193:0:6685:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.126@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787602371.068197:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787602371.068200:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787602371.068201:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787602371.068202:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787602371.068203:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787602371.068205:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787602371.068206:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787602371.068208:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787602371.068209:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787602371.068210:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787602371.068211:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787602371.068216:0:6685:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787602371.068218:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787602371.068219:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787602371.068221:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787602371.068222:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787602371.068223:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787602371.068224:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787602371.068225:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787602371.068226:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787602371.068227:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787602371.068228:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787602371.068229:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787602371.068257:0:6685:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787602371.068278:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853601280:0@lo:253: 00000100:00100000:1.0:1787602371.068353:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602371.068424:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3539786cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602371.068662:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853601280 00000100:00100000:2.0:1787602371.068671:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853601280 00000100:00100000:2.0:1787602371.068739:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787602371.068784:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853601280:12345-0@lo:253: 20000000:01000000:2.0:1787602371.068821:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787602371.068825:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787602371.068831:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787602371.068835:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787602371.069778:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787602371.070011:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787602371.070025:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787602371.070063:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787602371.070070:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787602371.070098:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787602371.070143:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787602371.070441:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787602371.070460:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.126@tcp 20000000:01000000:2.0:1787602371.070462:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.126@tcp (null) (null) (null) 00000040:00080000:2.0:1787602371.070495:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787602371.070503:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787602371.070567:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787602371.070576:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.126@tcp (null) (null) 00000040:00080000:2.0:1787602371.070608:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787602371.070617:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787602371.070659:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787602371.070711:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1787602371.071417:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787602371.071433:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.126@tcp 20000000:01000000:2.0:1787602371.071435:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.126@tcp (null) (null) (null) 00000040:00080000:2.0:1787602371.071470:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787602371.071477:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787602371.071508:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787602371.071515:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.126@tcp (null) (null) 00000040:00080000:2.0:1787602371.071575:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787602371.071586:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787602371.071618:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787602371.073956:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787602371.074011:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787602371.074014:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787602371.074019:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787602371.074036:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787602371.074038:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787602371.074106:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787602371.074109:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787602371.075060:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787602371.075140:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787602371.075186:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787602371.078188:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1787602371.078291:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1787602371.078333:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1787602371.078355:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787602371.078357:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787602371.080432:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787602371.080517:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787602371.080594:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787602371.081051:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787602371.081094:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787602371.081154:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787602371.081168:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787602371.081170:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787602371.082108:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787602371.082368:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787602371.082411:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787602371.082497:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1787602371.082516:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1787602371.082518:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1787602371.082531:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787602371.082575:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3500030c00/0x3640686da09dafc5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.082592:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3511047c00/0x3640686da09daede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09daed7 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.082600:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3500031a00/0x3640686da09daefa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09daef3 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.082606:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3511047800/0x3640686da09daf6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09daf63 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.082612:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3500030c00/0x3640686da09dafc5 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.082667:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3511047800/0x3640686da09daf6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09daf63 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.082684:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3511047800/0x3640686da09daf6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09daf63 expref: 12 pid: 5829 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602371.082701:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874436853601408:0@lo:104: 00000100:00100000:0.0:1787602371.083238:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602371.083311:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3500031a00/0x3640686da09daefa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09daef3 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.083321:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3500031a00/0x3640686da09daefa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09daef3 expref: 12 pid: 5831 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602371.083331:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874436853601536:0@lo:104: 00000100:00100000:0.0:1787602371.083350:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602371.083431:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3511047c00/0x3640686da09daede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09daed7 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.083440:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3511047c00/0x3640686da09daede lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09daed7 expref: 12 pid: 5831 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602371.083449:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874436853601664:0@lo:104: 00000100:00100000:0.0:1787602371.083469:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602371.097215:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853601408 00000100:00100000:1.0:1787602371.097232:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853601408 00000100:00100000:1.0:1787602371.103009:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853601536 00000100:00100000:1.0:1787602371.103025:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853601536 00000100:00100000:1.0:1787602371.103039:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853601664 00000100:00100000:1.0:1787602371.103042:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853601664 00000100:00100000:1.0:1787602371.103059:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787602371.103068:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+5:5832:x1874436853601408:12345-0@lo:104: 00010000:00010000:1.0:1787602371.103089:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09daf63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09daf6a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.103203:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602371.103210:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+5:5832:x1874436853601408:12345-0@lo:104: Request processed in 143us (19974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602371.103217:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787602371.103236:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602371.103243:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+4:5832:x1874436853601536:12345-0@lo:104: 00010000:00010000:1.0:1787602371.103250:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09daef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09daefa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.103289:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787602371.103294:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+4:5832:x1874436853601536:12345-0@lo:104: Request processed in 53us (19944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602371.103300:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602371.103312:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787602371.103318:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:5832:x1874436853601664:12345-0@lo:104: 00010000:00010000:1.0:1787602371.103326:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3503702600/0x3640686da09daed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09daede expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.103371:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787602371.103376:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:5832:x1874436853601664:12345-0@lo:104: Request processed in 59us (19907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602371.103382:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787602371.107465:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787602371.107480:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09daf63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09daf6a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.107492:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702000 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:3.0:1787602371.107496:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09daf63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09daf6a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.107505:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09daf63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09daf6a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602371.107513:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09daf63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09daf6a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602371.107519:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787602371.107594:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09daf63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daf6a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.107601:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602371.107624:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09daf63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daf6a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.107631:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09daf63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daf6a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.107682:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787602371.107685:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09daef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09daefa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.107690:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3500031600 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:3.0:1787602371.107693:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09daef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09daefa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.107699:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09daef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09daefa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602371.107705:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09daef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09daefa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602371.107710:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787602371.107739:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09daef3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daefa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.107887:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602371.107895:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09daef3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daefa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.107900:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09daef3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daefa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.107913:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602371.107916:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3503702600/0x3640686da09daed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09daede expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.107931:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702600 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:3.0:1787602371.107934:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3503702600/0x3640686da09daed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09daede expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.107942:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3503702600/0x3640686da09daed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09daede expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602371.107948:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3503702600/0x3640686da09daed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09daede expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602371.107954:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787602371.107978:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3503702600/0x3640686da09daed7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daede expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.107984:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602371.108000:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3503702600/0x3640686da09daed7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daede expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.108006:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3503702600/0x3640686da09daed7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daede expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.108020:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602371.108021:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602371.108023:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602371.108040:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853601792:0@lo:103: 00000100:00100000:3.0:1787602371.108112:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602371.108242:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853602048:0@lo:103: 00010000:00010000:1.0:1787602371.108838:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602371.109288:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3509274b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602371.109333:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874436853601408:0@lo:104: 00000100:00100000:0.0:1787602371.109343:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874436853601536:0@lo:104: 00000100:00100000:0.0:1787602371.109351:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874436853601664:0@lo:104: 00010000:00010000:0.0:1787602371.109388:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3500030c00/0x3640686da09dafc5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602371.109455:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853601792 00000100:00100000:0.0:1787602371.109461:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853601792 00010000:00010000:0.0:1787602371.109490:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3511047800/0x3640686da09daf6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09daf63 expref: 13 pid: 5829 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602371.109531:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787602371.109540:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:3301:x1874436853601792:12345-0@lo:103: 00010000:00010000:0.0:1787602371.109688:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602371.109696:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3511047800/0x3640686da09daf6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09daf63 expref: 13 pid: 5829 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.109708:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3511047800/0x3640686da09daf6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09daf63 expref: 13 pid: 5829 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.109740:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3511047800/0x3640686da09daf6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09daf63 expref: 13 pid: 5829 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.109774:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602371.109827:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:3301:x1874436853601792:12345-0@lo:103: Request processed in 288us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602371.109834:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787602371.109864:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853601920:0@lo:103: 00000100:00100000:0.0:1787602371.109894:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602371.110825:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853601920 00000100:00100000:1.0:1787602371.110834:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853601920 00010000:00010000:0.0:1787602371.111006:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3500031a00/0x3640686da09daefa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09daef3 expref: 12 pid: 5831 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602371.111041:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787602371.111049:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:3302:x1874436853601920:12345-0@lo:103: 00010000:00010000:0.0:1787602371.111059:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602371.111064:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3500031a00/0x3640686da09daefa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09daef3 expref: 12 pid: 5831 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.111073:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3500031a00/0x3640686da09daefa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09daef3 expref: 12 pid: 5831 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.111088:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3500031a00/0x3640686da09daefa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09daef3 expref: 12 pid: 5831 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.111102:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602371.111153:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:3302:x1874436853601920:12345-0@lo:103: Request processed in 105us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602371.111159:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602371.111224:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853601920:0@lo:103: 00000100:00100000:2.0:1787602371.112476:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602371.112653:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853602048 00000100:00100000:0.0:1787602371.112660:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853602048 00010000:00010000:0.0:1787602371.112692:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3511047c00/0x3640686da09daede lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09daed7 expref: 11 pid: 5831 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602371.112728:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787602371.112737:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:3303:x1874436853602048:12345-0@lo:103: 00010000:00010000:0.0:1787602371.112770:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602371.112776:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3511047c00/0x3640686da09daede lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09daed7 expref: 11 pid: 5831 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.112788:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3511047c00/0x3640686da09daede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09daed7 expref: 11 pid: 5831 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.112803:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3511047c00/0x3640686da09daede lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09daed7 expref: 11 pid: 5831 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.112820:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3500030c00/0x3640686da09dafc5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.112829:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3500030c00/0x3640686da09dafc5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.112846:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3500030c00/0x3640686da09dafc5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.112853:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3500030c00/0x3640686da09dafc5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.112860:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3500030c00/0x3640686da09dafc5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.112883:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3500030c00/0x3640686da09dafc5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.112889:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3500030c00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602371.112894:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3500030c00/0x3640686da09dafc5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.112902:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3500030c00/0x3640686da09dafc5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.113530:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3500030c00/0x3640686da09dafc5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.113608:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602371.113677:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+10:3303:x1874436853602048:12345-0@lo:103: Request processed in 941us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602371.113685:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602371.114318:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853602048:0@lo:103: 00010000:00010000:1.0:1787602371.114489:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3500030c00/0x3640686da09dafc5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.114499:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3500030c00/0x3640686da09dafc5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.114506:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3500030c00/0x3640686da09dafc5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787602371.114524:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787602371.115992:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853601792:0@lo:103: 00010000:00010000:3.0:1787602371.245819:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602371.298348:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+9:6685:x1874436853601280:12345-0@lo:253: Request processed in 229557us (229984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602371.298365:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787602371.298475:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853601280:0@lo:253: 10000000:01000000:1.0:1787602371.298492:0:6685:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787602371.298495:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787602371.298497:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787602371.298498:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787602371.298500:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787602371.298501:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787602371.298502:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787602371.298504:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787602371.298505:0:6685:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787602371.298507:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787602371.298508:0:6685:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787602371.298547:0:6685:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d353d79c800 from lustre-OST0000 10000000:01000000:1.0:1787602371.298575:0:6685:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787602371.298578:0:6685:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787602371.298585:0:6685:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d350c9c3370 local copy 10000000:01000000:1.0:1787602371.298590:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787602371.298629:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09dafcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.298649:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09dafcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.298660:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09dafcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602371.298679:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853602176:0@lo:101: 00000100:00100000:1.0:1787602371.298733:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602371.298825:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3539786cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602371.298949:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853602176 00000100:00100000:2.0:1787602371.298957:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853602176 00000100:00100000:2.0:1787602371.299005:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787602371.299022:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+9:6685:x1874436853602176:12345-0@lo:101: 00010000:00010000:2.0:1787602371.299036:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602371.299050:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3503703200/0x3640686da09dafd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dafcc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602371.299074:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503703200/0x3640686da09dafd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dafcc expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602371.299083:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3503703200/0x3640686da09dafd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dafcc expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602371.299092:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503703200, rc 0) 00000100:00100000:2.0:1787602371.299133:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+10:6685:x1874436853602176:12345-0@lo:101: Request processed in 114us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602371.299139:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787602371.299214:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853602176:0@lo:101: 00010000:00010000:3.0:1787602371.299227:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09dafcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3640686da09dafd3 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.299235:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09dafcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3640686da09dafd3 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602371.299450:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853602304:0@lo:501: 00000100:00100000:3.0:1787602371.299479:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602371.299504:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3508036a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787602371.299563:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853602304 00000100:00100000:0.0:1787602371.299568:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853602304 00000100:00100000:0.0:1787602371.299599:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787602371.299607:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+10:6685:x1874436853602304:12345-0@lo:501: 00000100:00100000:0.0:1787602371.299864:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+10:6685:x1874436853602304:12345-0@lo:501: Request processed in 256us (383us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787602371.299870:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787602371.299983:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853602304:0@lo:501: 10000000:01000000:3.0:1787602371.299996:0:6685:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787602371.300024:0:6685:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787602371.300030:0:6685:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09dafcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3640686da09dafd3 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.300038:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09dafcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3640686da09dafd3 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.300046:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09dafcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3640686da09dafd3 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.300071:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787602371.300090:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d353d79c800 10000000:01000000:3.0:1787602371.300095:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787602371.300107:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d350c9c3370 10000000:01000000:3.0:1787602371.300110:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787602371.300113:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d350c9c3370 from 1 10000000:01000000:3.0:1787602371.300115:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787602371.300135:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3511046a00/0x3640686da09dafda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.300142:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3511046a00/0x3640686da09dafda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.300150:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3511046a00/0x3640686da09dafda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602371.300162:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853602432:0@lo:101: 00000100:00100000:3.0:1787602371.300188:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602371.300220:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3508036780 going to sleep for 11 seconds 00010000:00010000:0.0:1787602371.300282:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602371.300289:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09dafcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3640686da09dafd3 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.300297:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3528f20800 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:0.0:1787602371.300308:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09dafcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3640686da09dafd3 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.300317:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09dafcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x3640686da09dafd3 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602371.300325:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09dafcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x3640686da09dafd3 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602371.300331:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602371.300351:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09dafcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3640686da09dafd3 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.300358:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602371.300383:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09dafcc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3640686da09dafd3 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.300390:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09dafcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3640686da09dafd3 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.300406:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602371.300408:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602371.300410:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602371.300547:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853602560:0@lo:103: 00000100:00100000:3.0:1787602371.300577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602371.300668:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853602432 00000100:00100000:2.0:1787602371.300674:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853602432 00000100:00100000:2.0:1787602371.300708:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787602371.300716:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+10:6685:x1874436853602432:12345-0@lo:101: 00010000:00010000:2.0:1787602371.300725:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602371.300738:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3503703400/0x3640686da09dafe1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dafda expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602371.300786:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503703400/0x3640686da09dafe1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dafda expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602371.300794:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3503703400/0x3640686da09dafe1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dafda expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602371.300802:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503703400, rc 0) 00000100:00100000:2.0:1787602371.300841:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:6685:x1874436853602432:12345-0@lo:101: Request processed in 126us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602371.300847:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787602371.300925:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853602432:0@lo:101: 00010000:00010000:3.0:1787602371.300937:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3511046a00/0x3640686da09dafda lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dafe1 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.300945:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3511046a00/0x3640686da09dafda lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dafe1 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602371.300959:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787602371.300976:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3511046a00/0x3640686da09dafda lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dafe1 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.300983:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3511046a00/0x3640686da09dafda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dafe1 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602371.300995:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787602371.300999:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787602371.301004:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787602371.301006:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787602371.301021:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09dafe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.301027:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09dafe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.301034:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09dafe8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602371.301045:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853602688:0@lo:101: 00000100:00100000:3.0:1787602371.301068:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602371.301087:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3508036780 going to sleep for 11 seconds 00000100:00100000:3.0:1787602371.301098:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853602688 00000100:00100000:3.0:1787602371.301101:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853602688 00000100:00100000:3.0:1787602371.301120:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787602371.301125:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:6685:x1874436853602688:12345-0@lo:101: 00010000:00010000:3.0:1787602371.301131:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602371.301137:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3511046400/0x3640686da09dafef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dafe8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.301149:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3511046400/0x3640686da09dafef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dafe8 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.301156:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3511046400/0x3640686da09dafef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dafe8 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.301168:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3511046400, rc 0) 00000100:00100000:3.0:1787602371.301191:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853602688:12345-0@lo:101: Request processed in 66us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602371.301197:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787602371.301226:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853602688:0@lo:101: 00010000:00010000:3.0:1787602371.301235:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09dafe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dafef expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.301242:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09dafe8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dafef expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602371.301422:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853602816:0@lo:501: 00000100:00100000:3.0:1787602371.301444:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602371.301457:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3508036780 going to sleep for 11 seconds 00000100:00100000:3.0:1787602371.301469:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853602816 00000100:00100000:3.0:1787602371.301472:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853602816 00000100:00100000:3.0:1787602371.301491:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787602371.301496:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853602816:12345-0@lo:501: 00000100:00100000:3.0:1787602371.301691:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853602816:12345-0@lo:501: Request processed in 194us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602371.301698:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787602371.301729:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853602816:0@lo:501: 00000100:00100000:3.0:1787602371.301782:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853602944:0@lo:503: 00000100:00100000:3.0:1787602371.301820:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602371.301839:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353466bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787602371.301857:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853602944 00000100:00100000:3.0:1787602371.301861:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853602944 00000100:00100000:3.0:1787602371.301880:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787602371.301885:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853602944:12345-0@lo:503: 00000100:00100000:3.0:1787602371.302029:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853602944:12345-0@lo:503: Request processed in 143us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602371.302035:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787602371.302074:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853602944:0@lo:503: 00000100:00100000:0.0:1787602371.302492:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853602560 00000100:00100000:0.0:1787602371.302497:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853602560 00000100:00100000:0.0:1787602371.302540:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602371.302547:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:3304:x1874436853602560:12345-0@lo:103: 00010000:00010000:0.0:1787602371.302557:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602371.302574:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3503703200/0x3640686da09dafd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3640686da09dafcc expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.302599:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602371.302637:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:3304:x1874436853602560:12345-0@lo:103: Request processed in 91us (2059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602371.302652:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1787602371.306520:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787602371.306650:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853603072:0@lo:502: 00000100:00100000:3.0:1787602371.306733:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602371.306800:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3506b1d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787602371.306849:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853602560:0@lo:103: 00000100:00100000:0.0:1787602371.308416:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853603072 00000100:00100000:0.0:1787602371.308431:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853603072 00000100:00100000:0.0:1787602371.308498:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787602371.308510:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:6685:x1874436853603072:12345-0@lo:502: 00000100:00100000:0.0:1787602371.308810:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:6685:x1874436853603072:12345-0@lo:502: Request processed in 301us (2075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602371.308818:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787602371.309372:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853603072:0@lo:502: 00000040:00080000:1.0:1787602371.309704:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787602371.309800:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787602371.309837:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787602371.309886:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787602371.309920:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787602371.309952:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787602371.309991:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853603200:0@lo:502: 00000100:00100000:1.0:1787602371.310046:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602371.310087:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3539786cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602371.313796:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853603200 00000100:00100000:3.0:1787602371.313811:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853603200 00000100:00100000:3.0:1787602371.313876:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787602371.313886:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:6685:x1874436853603200:12345-0@lo:502: 00000100:00100000:3.0:1787602371.314157:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:6685:x1874436853603200:12345-0@lo:502: Request processed in 272us (4111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602371.314166:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787602371.315676:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853603200:0@lo:502: 00000040:00080000:1.0:1787602371.315909:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787602371.315926:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787602371.317058:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787602371.317069:0:6705:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787602371.317076:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602371.317078:0:6705:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787602371.317083:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787602371.317098:0:6705:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d350c9c0000) 00000020:00000080:1.0:1787602371.317122:0:6705:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787602371.317128:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787602371.317202:0:6705:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d353d79c800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787602371.317210:0:6705:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787602371.317218:0:6705:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3640686da09daffd 00010000:00010000:1.0:1787602371.323009:0:6705:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787602371.327232:0:6705:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787602371.330025:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787602371.330532:0:6705:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787602371.336099:0:6705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787602371.336706:0:6705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787602371.350276:0:6705:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787602371.350290:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602371.350297:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602371.350300:0:6705:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787602371.350303:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602371.350307:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602371.350308:0:6705:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787602371.350311:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787602371.350320:0:6705:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787602371.350379:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602371.350383:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602371.350385:0:6705:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787602371.350388:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787602371.350539:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787602371.350563:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787602371.350585:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09dafe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dafef expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.350598:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09dafe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dafef expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602371.350606:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d353d79c800 from 1 10000000:01000000:1.0:1787602371.350609:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787602371.350654:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db004 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.350664:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db004 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.350675:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db004 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602371.350699:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853603328:0@lo:101: 00000100:00100000:1.0:1787602371.350808:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602371.350850:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35033f9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602371.350971:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853603328 00000100:00100000:3.0:1787602371.350979:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853603328 00000100:00100000:3.0:1787602371.351025:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787602371.351035:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:6685:x1874436853603328:12345-0@lo:101: 00010000:00010000:3.0:1787602371.351049:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602371.351063:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3511046600/0x3640686da09db00b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db004 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.351087:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3511046600/0x3640686da09db00b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db004 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.351100:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3511046600/0x3640686da09db00b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db004 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.351109:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3511046600, rc 0) 00000100:00100000:3.0:1787602371.351147:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853603328:12345-0@lo:101: Request processed in 113us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602371.351153:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787602371.351235:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853603328:0@lo:101: 00010000:00010000:1.0:1787602371.351249:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db004 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db00b expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.351272:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db004 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db00b expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602371.351368:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853603456:0@lo:501: 00000100:00100000:1.0:1787602371.351394:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602371.351418:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35033f9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602371.351461:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853603456 00000100:00100000:3.0:1787602371.351466:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853603456 00000100:00100000:3.0:1787602371.351496:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787602371.351503:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853603456:12345-0@lo:501: 00000100:00100000:3.0:1787602371.351738:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853603456:12345-0@lo:501: Request processed in 235us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602371.351766:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787602371.351801:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853603456:0@lo:501: 00000100:00100000:3.0:1787602371.351824:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853603584:0@lo:503: 00000100:00100000:3.0:1787602371.351856:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602371.351866:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3506b1d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602371.351965:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853603584 00000100:00100000:1.0:1787602371.351969:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853603584 00000100:00100000:1.0:1787602371.351994:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787602371.352000:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853603584:12345-0@lo:503: 00000100:00100000:1.0:1787602371.352140:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853603584:12345-0@lo:503: Request processed in 139us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602371.352146:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787602371.355674:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853603584:0@lo:503: 00000040:00080000:3.0:1787602371.356063:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787602371.356139:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853603712:0@lo:502: 00000100:00100000:3.0:1787602371.356220:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602371.356255:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353466bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602371.356403:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853603712 00000100:00100000:1.0:1787602371.356410:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853603712 00000100:00100000:1.0:1787602371.356458:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787602371.356468:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853603712:12345-0@lo:502: 00000100:00100000:1.0:1787602371.356665:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853603712:12345-0@lo:502: Request processed in 198us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602371.356673:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787602371.358434:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853603712:0@lo:502: 00000040:00080000:3.0:1787602371.358805:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787602371.358866:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787602371.358905:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853603840:0@lo:502: 00000100:00100000:3.0:1787602371.358975:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602371.359024:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3506b1d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602371.359786:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853603840 00000100:00100000:2.0:1787602371.359796:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853603840 00000100:00100000:2.0:1787602371.359854:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787602371.359864:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853603840:12345-0@lo:502: 00000100:00100000:2.0:1787602371.360087:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853603840:12345-0@lo:502: Request processed in 224us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602371.360095:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787602371.360401:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534977100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853603840:0@lo:502: 00000040:00080000:3.0:1787602371.360527:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787602371.360540:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787602371.365607:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602371.365623:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602371.365625:0:6709:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787602371.365632:0:6709:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d353d79c800 00000020:00000080:3.0:1787602371.365634:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787602371.365665:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602371.365669:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602371.365670:0:6709:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787602371.365673:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787602371.365961:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787602371.365988:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602371.366015:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db004 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db00b expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.366026:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db004 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db00b expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602371.366069:0:6685:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787602371.366072:0:6685:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d353d79c800 10000000:01000000:0.0:1787602371.366075:0:6685:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d353d79c800 10000000:01000000:0.0:1787602371.366079:0:6685:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787602371.366084:0:6685:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d353d79c800 from 1 10000000:01000000:0.0:1787602371.366086:0:6685:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787602371.366127:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.366145:0:6685:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.366157:0:6685:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db012 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602371.366179:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853603968:0@lo:101: 00000100:00100000:0.0:1787602371.366258:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602371.366308:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3509274e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787602371.366367:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853603968 00000100:00100000:2.0:1787602371.366375:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853603968 00000100:00100000:2.0:1787602371.366425:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787602371.366435:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853603968:12345-0@lo:101: 00010000:00010000:2.0:1787602371.366447:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602371.366460:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3503703a00/0x3640686da09db019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db012 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602371.366483:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503703a00/0x3640686da09db019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db012 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602371.366494:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3503703a00/0x3640686da09db019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db012 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602371.366514:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503703a00, rc 0) 00000100:00100000:2.0:1787602371.366557:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:6685:x1874436853603968:12345-0@lo:101: Request processed in 123us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602371.366564:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787602371.366660:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853603968:0@lo:101: 00010000:00010000:0.0:1787602371.366673:0:6685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db019 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.366681:0:6685:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db012 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db019 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602371.366809:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853604096:0@lo:501: 00000100:00100000:0.0:1787602371.366831:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602371.366841:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3509274e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602371.367906:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853604096 00000100:00100000:3.0:1787602371.367915:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853604096 00000100:00100000:3.0:1787602371.369090:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787602371.369105:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:6685:x1874436853604096:12345-0@lo:501: 00000100:00100000:3.0:1787602371.369405:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:6685:x1874436853604096:12345-0@lo:501: Request processed in 304us (2571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602371.369413:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787602371.369509:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853604096:0@lo:501: 00000100:00100000:0.0:1787602371.369559:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853604224:0@lo:503: 00000100:00100000:0.0:1787602371.369606:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602371.377051:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3509274e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787602371.377133:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853604224 00000100:00100000:2.0:1787602371.377143:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853604224 00000100:00100000:2.0:1787602371.377214:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787602371.377224:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:6685:x1874436853604224:12345-0@lo:503: 00000100:00100000:1.0:1787602371.379075:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:6685:x1874436853604224:12345-0@lo:503: Request processed in 1844us (9460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602371.379088:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787602371.379184:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853604224:0@lo:503: 00000040:00080000:2.0:1787602371.379924:0:6685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787602371.380005:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853604352:0@lo:502: 00000100:00100000:2.0:1787602371.380066:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602371.380144:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d340428b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787602371.380178:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853604352 00000100:00100000:3.0:1787602371.380184:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853604352 00000100:00100000:3.0:1787602371.380252:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787602371.380261:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:6685:x1874436853604352:12345-0@lo:502: 00000100:00100000:3.0:1787602371.380482:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:6685:x1874436853604352:12345-0@lo:502: Request processed in 222us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602371.380489:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787602371.380555:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853604352:0@lo:502: 00000040:00080000:2.0:1787602371.380839:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787602371.380888:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787602371.380923:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787602371.380986:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787602371.381020:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787602371.381063:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787602371.381098:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787602371.381132:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787602371.381187:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787602371.381223:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787602371.381253:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787602371.381299:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787602371.381335:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787602371.381373:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787602371.381415:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787602371.381450:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787602371.381482:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787602371.381527:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787602371.381556:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787602371.381582:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787602371.381618:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787602371.381679:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787602371.381707:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787602371.381774:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787602371.381812:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787602371.381845:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787602371.381891:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787602371.381922:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787602371.381959:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853604480:0@lo:502: 00000100:00100000:2.0:1787602371.382013:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602371.382660:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d340428b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787602371.382704:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853604480 00000100:00100000:1.0:1787602371.382712:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853604480 00000100:00100000:1.0:1787602371.382779:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787602371.382788:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:6685:x1874436853604480:12345-0@lo:502: 00000100:00100000:1.0:1787602371.383071:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:6685:x1874436853604480:12345-0@lo:502: Request processed in 284us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602371.383079:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787602371.383184:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853604480:0@lo:502: 00000040:00080000:2.0:1787602371.383258:0:6685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787602371.383271:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787602371.384230:0:6710:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787602371.384258:0:6710:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d34049c4d28) 00000020:00000080:2.0:1787602371.384283:0:6710:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787602371.385150:0:6710:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d353d79c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787602371.385157:0:6710:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d353d79c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787602371.385160:0:6710:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d353d79c800 3 00010000:00080000:3.0:1787602371.385192:0:6710:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d353787f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.126@tcp at head 00010000:00010000:3.0:1787602371.390162:0:6710:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1787602371.390397:0:6710:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787602371.390448:0:6710:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787602371.390460:0:6710:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3640686da09db027 00000100:00080000:3.0:1787602371.390470:0:6710:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787602371.390476:0:6710:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d353787f000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:3.0:1787602371.390509:0:6710:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3534977100 x1874436853604608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787602371.390570:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1874436853604608:0@lo:38: 00000100:00100000:2.0:1787602371.390651:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787602371.390713:0:6710:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787602371.390805:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853604736:0@lo:400: 00000100:00100000:0.0:1787602371.390806:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853604608 00000100:00100000:0.0:1787602371.390814:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853604608 00000100:00100000:3.0:1787602371.390837:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602371.390848:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853604736 00000100:00100000:0.0:1787602371.390851:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853604736 00000100:00100000:3.0:1787602371.390879:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602371.390974:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853604736:12345-0@lo:400: 00000100:00100000:3.0:1787602371.391025:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853604736:12345-0@lo:400: Request processed in 138us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602371.391544:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787602371.391550:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3300:x1874436853604608:12345-0@lo:38: 00010000:00080000:0.0:1787602371.391571:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:0.0:1787602371.391598:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3640686da09db02e 00000004:00100000:0.0:1787602371.391612:0:5837:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787602371.391651:0:5837:0:(import.c:65:import_set_state_nolock()) ffff8d3404328800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787602371.391708:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874436853604608:12345-0@lo:38: Request processed in 158us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602371.392357:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787602371.393582:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d3534977100 x1874436853604608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787602381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602371.393595:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787602371.393612:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787602371.393620:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787602371.393625:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787602371.393628:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d353787f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787602371.393635:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1874436853604608:0@lo:38: 00000100:00100000:3.0:1787602371.394557:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787602371.394628:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d3534977480 x1874436853604736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602371.394653:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853604736:0@lo:400: 00000040:00080000:2.0:1787602371.395046:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1787602371.395592:0:6685:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787602371.395616:0:6685:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787602371.395678:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db012 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db019 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.395690:0:6685:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db019 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787602371.395735:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787602371.395737:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787602371.395739:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602371.395740:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602371.395774:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602371.395776:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602371.395777:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787602371.395779:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787602371.395780:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787602371.395782:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602371.395783:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787602371.395788:0:6685:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787602371.395791:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787602371.395801:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787602371.395808:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602371.395809:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602371.395810:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602371.395811:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602371.395812:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787602371.395813:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787602371.395814:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787602371.395815:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602371.395815:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787602371.395836:0:6685:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787602371.395851:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534977480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853604864:0@lo:253: 00000100:00100000:3.0:1787602371.395922:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602371.395960:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353466bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602371.396048:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853604864 00000100:00100000:1.0:1787602371.396055:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853604864 00000100:00100000:1.0:1787602371.396096:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787602371.396106:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:6685:x1874436853604864:12345-0@lo:253: 20000000:01000000:1.0:1787602371.396132:0:5829:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787602371.396145:0:5829:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787602371.439612:0:5829:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787602371.439632:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787602371.439671:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787602371.439677:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787602371.439701:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3528f20c00/0x3640686da09db035 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.439729:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3500031e00/0x3640686da09daf94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09daf8d expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.439739:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3528f20c00/0x3640686da09db035 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.439813:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3500031e00/0x3640686da09daf94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09daf8d expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.439844:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3500031e00/0x3640686da09daf94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09daf8d expref: 13 pid: 5832 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602371.439859:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874436853604992:0@lo:104: 00000100:00100000:1.0:1787602371.439923:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602371.439978:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35033f93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602371.439999:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853604992 00000100:00100000:1.0:1787602371.440005:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853604992 00000100:00100000:1.0:1787602371.440054:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787602371.440064:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:5852:x1874436853604992:12345-0@lo:104: 00010000:00010000:1.0:1787602371.440078:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3511046e00/0x3640686da09daf8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09daf94 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.440136:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602371.440142:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:5852:x1874436853604992:12345-0@lo:104: Request processed in 80us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602371.440148:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787602371.440204:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874436853604992:0@lo:104: 00010000:00010000:0.0:1787602371.440223:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3528f20c00/0x3640686da09db035 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.440273:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602371.440280:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3511046e00/0x3640686da09daf8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09daf94 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.440287:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3511046e00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:3.0:1787602371.440291:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3511046e00/0x3640686da09daf8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09daf94 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.440299:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3511046e00/0x3640686da09daf8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09daf94 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602371.440306:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3511046e00/0x3640686da09daf8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09daf94 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602371.440312:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787602371.440347:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3511046e00/0x3640686da09daf8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daf94 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.440354:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602371.440379:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3511046e00/0x3640686da09daf8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daf94 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602371.440398:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3511046e00/0x3640686da09daf8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09daf94 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602371.440409:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853605120:0@lo:103: 00010000:00010000:3.0:1787602371.440413:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602371.440415:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602371.440417:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602371.440514:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602371.440678:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853605120 00000100:00100000:0.0:1787602371.440682:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853605120 00010000:00010000:0.0:1787602371.440701:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3500031e00/0x3640686da09daf94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09daf8d expref: 14 pid: 5832 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602371.440729:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787602371.440736:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3509d56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:3302:x1874436853605120:12345-0@lo:103: 00010000:00010000:0.0:1787602371.440781:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602371.440787:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3500031e00/0x3640686da09daf94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09daf8d expref: 14 pid: 5832 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.440797:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3500031e00/0x3640686da09daf94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09daf8d expref: 14 pid: 5832 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.440822:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3500031e00/0x3640686da09daf94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09daf8d expref: 14 pid: 5832 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.440835:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3528f20c00/0x3640686da09db035 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.440843:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3528f20c00/0x3640686da09db035 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787602371.440855:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001306066s 00010000:00010000:0.0:1787602371.440860:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3528f20c00/0x3640686da09db035 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.440867:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3528f20c00/0x3640686da09db035 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.440874:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3528f20c00/0x3640686da09db035 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.440880:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3528f20c00/0x3640686da09db035 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.440884:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3528f20c00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602371.440888:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3528f20c00/0x3640686da09db035 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.440895:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3528f20c00/0x3640686da09db035 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.440915:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3528f20c00/0x3640686da09db035 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602371.440934:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602371.440966:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3509d56050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:3302:x1874436853605120:12345-0@lo:103: Request processed in 231us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602371.440973:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787602371.441077:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853605120:0@lo:103: 00010000:00010000:1.0:1787602371.441429:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3528f20c00/0x3640686da09db035 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.441554:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3528f20c00/0x3640686da09db035 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602371.441562:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3528f20c00/0x3640686da09db035 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602371.478530:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:6685:x1874436853604864:12345-0@lo:253: Request processed in 82414us (82595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602371.478546:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787602371.478683:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534977480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6685:1874436853604864:0@lo:253: 10000000:01000000:3.0:1787602371.478701:0:6685:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787602371.478704:0:6685:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787602371.478706:0:6685:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787602371.478707:0:6685:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602371.478709:0:6685:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602371.478710:0:6685:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602371.478711:0:6685:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602371.478713:0:6685:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787602371.478715:0:6685:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787602371.478716:0:6685:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787602371.478718:0:6685:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602371.478719:0:6685:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787602371.478736:0:6685:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787602371.487247:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602371.487415:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787602371.487601:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602371.487812:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787602371.488015:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602371.488243:0:6685:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787602371.493206:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787602371.711940:0:6685:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787602371.711949:0:6685:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787602371.712044:0:6685:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787602371.712173:0:6685:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787602371.712194:0:6685:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787602371.712222:0:6685:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787602372.269791:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602373.300403:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602374.317284:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602375.341259:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602376.365268:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602376.816494:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853605248:0@lo:400: 00000100:00100000:3.0:1787602376.816573:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602376.816636:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787602376.816642:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853605376:0@lo:400: 00000100:00100000:3.0:1787602376.816671:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602376.816704:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874436853605504:0@lo:400: 00000100:00100000:3.0:1787602376.816727:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602376.816785:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853605376 00000100:00100000:3.0:1787602376.816798:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853605376 00000100:00100000:3.0:1787602376.816835:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853605504 00000100:00100000:3.0:1787602376.816837:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853605504 00000100:00100000:3.0:1787602376.816857:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602376.816865:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853605376:12345-0@lo:400: 00000100:00100000:3.0:1787602376.816914:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853605376:12345-0@lo:400: Request processed in 50us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602376.816921:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602376.816938:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787602376.816945:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874436853605504:12345-0@lo:400: 00000100:00100000:3.0:1787602376.816973:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874436853605504:12345-0@lo:400: Request processed in 29us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602376.816978:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787602376.817015:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787602376.817043:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3503e4fb80 x1874436853605504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602376.817057:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874436853605504:0@lo:400: 00010000:00080000:3.0:1787602376.817079:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3503e4f800 x1874436853605376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602376.817087:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853605376:0@lo:400: 00000100:00100000:0.0:1787602376.817224:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853605248 00000100:00100000:0.0:1787602376.817228:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853605248 00000100:00100000:0.0:1787602376.817252:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787602376.817258:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:3303:x1874436853605248:12345-0@lo:400: 00000100:00100000:0.0:1787602376.817291:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:3303:x1874436853605248:12345-0@lo:400: Request processed in 34us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602376.817297:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787602376.817831:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853605248:0@lo:400: 10000000:01000000:0.0:1787602377.324915:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787602377.324922:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3509288800 from 21 10000000:01000000:0.0:1787602377.324928:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787602377.324980:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031800/0x3640686da09db03c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602377.325013:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3500031800/0x3640686da09db03c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602377.325037:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3500031800/0x3640686da09db03c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602377.325060:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853605632:0@lo:101: 00000100:00100000:0.0:1787602377.325134:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602377.325195:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503df8780 going to sleep for 11 seconds 00000100:00100000:1.0:1787602377.325303:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853605632 00000100:00100000:1.0:1787602377.325312:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853605632 00000100:00100000:1.0:1787602377.325377:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787602377.325389:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5834:x1874436853605632:12345-0@lo:101: 00010000:00010000:1.0:1787602377.325403:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602377.325428:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3528f20800/0x3640686da09db043 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db03c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602377.325456:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3528f20800/0x3640686da09db043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db03c expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602377.325467:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3528f20800/0x3640686da09db043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db03c expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602377.325477:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3528f20800, rc 0) 00000100:00100000:1.0:1787602377.325532:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:5834:x1874436853605632:12345-0@lo:101: Request processed in 145us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602377.325549:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787602377.325824:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853605632:0@lo:101: 00010000:00010000:2.0:1787602377.325842:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3500031800/0x3640686da09db03c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db043 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602377.325853:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3500031800/0x3640686da09db03c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db043 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602377.325921:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853605760:0@lo:501: 00000100:00100000:2.0:1787602377.325951:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602377.325985:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3506b1d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602377.326046:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853605760 00000100:00100000:0.0:1787602377.326051:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853605760 00000100:00100000:0.0:1787602377.326081:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787602377.326089:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:5834:x1874436853605760:12345-0@lo:501: 00000100:00100000:0.0:1787602377.326470:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:5834:x1874436853605760:12345-0@lo:501: Request processed in 379us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602377.326477:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787602377.326715:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853605760:0@lo:501: 00000100:00100000:2.0:1787602377.326771:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853605888:0@lo:503: 00000100:00100000:2.0:1787602377.326807:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602377.326819:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3506b1d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602377.326879:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853605888 00000100:00100000:1.0:1787602377.326885:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853605888 00000100:00100000:1.0:1787602377.326923:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787602377.326931:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:5834:x1874436853605888:12345-0@lo:503: 00000100:00100000:1.0:1787602377.327234:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:5834:x1874436853605888:12345-0@lo:503: Request processed in 303us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602377.327247:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787602377.327365:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853605888:0@lo:503: 00000100:00100000:2.0:1787602377.327834:0:6987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6987:1874436853606016:0@lo:502: 00000100:00100000:2.0:1787602377.327873:0:6987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602377.327904:0:6987:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3506b1db40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602377.327958:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853606016 00000100:00100000:1.0:1787602377.327965:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853606016 00000100:00100000:1.0:1787602377.327998:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787602377.328006:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:6987:x1874436853606016:12345-0@lo:502: 00000100:00100000:1.0:1787602377.328247:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:6987:x1874436853606016:12345-0@lo:502: Request processed in 242us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602377.328254:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787602377.328371:0:6987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6987:1874436853606016:0@lo:502: 00000100:00100000:2.0:1787602377.328424:0:6987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6987:1874436853606144:0@lo:502: 00000100:00100000:2.0:1787602377.328457:0:6987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602377.328476:0:6987:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3506b1db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602377.328651:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853606144 00000100:00100000:0.0:1787602377.328657:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853606144 00000100:00100000:0.0:1787602377.328691:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787602377.328699:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:6987:x1874436853606144:12345-0@lo:502: 00000100:00100000:0.0:1787602377.328867:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:6987:x1874436853606144:12345-0@lo:502: Request processed in 168us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602377.328874:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787602377.329035:0:6987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6987:1874436853606144:0@lo:502: 00000040:00080000:2.0:1787602377.329056:0:6987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787602377.329255:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787602377.329274:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787602377.329284:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031800/0x3640686da09db03c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db043 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602377.329304:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3500031800/0x3640686da09db03c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db043 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602377.329315:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787602377.329317:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d3509288800 from 4 10000000:01000000:0.0:1787602377.329320:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787602377.329348:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500030400/0x3640686da09db04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602377.329356:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3500030400/0x3640686da09db04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602377.329365:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3500030400/0x3640686da09db04a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602377.329380:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853606272:0@lo:101: 00000100:00100000:0.0:1787602377.329477:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602377.329515:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503df8240 going to sleep for 11 seconds 00000100:00100000:1.0:1787602377.329717:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853606272 00000100:00100000:1.0:1787602377.329723:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853606272 00000100:00100000:1.0:1787602377.329786:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787602377.329795:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:5834:x1874436853606272:12345-0@lo:101: 00010000:00010000:1.0:1787602377.329805:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602377.329820:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3528f20c00/0x3640686da09db051 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db04a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602377.329844:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3528f20c00/0x3640686da09db051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db04a expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602377.329853:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3528f20c00/0x3640686da09db051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db04a expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602377.329863:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3528f20c00, rc 0) 00000100:00100000:1.0:1787602377.329897:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:5834:x1874436853606272:12345-0@lo:101: Request processed in 104us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602377.329903:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787602377.330213:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853606272:0@lo:101: 00010000:00010000:0.0:1787602377.330227:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3500030400/0x3640686da09db04a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db051 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602377.330237:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3500030400/0x3640686da09db04a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db051 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602377.330288:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853606400:0@lo:256: 00000100:00100000:0.0:1787602377.330340:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602377.330373:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503df8240 going to sleep for 11 seconds 00000100:00100000:1.0:1787602377.330430:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853606400 00000100:00100000:1.0:1787602377.330435:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853606400 00000100:00100000:1.0:1787602377.330472:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787602377.330480:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:5834:x1874436853606400:12345-0@lo:256: 20000000:01000000:1.0:1787602377.330494:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787602377.330512:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787602377.330515:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787602377.330607:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:5834:x1874436853606400:12345-0@lo:256: Request processed in 127us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602377.330772:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853606400:0@lo:256: 10000000:01000000:0.0:1787602377.330812:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787602377.330819:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500030400/0x3640686da09db04a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db051 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602377.330828:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3500030400/0x3640686da09db04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db051 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602377.330836:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787602377.330838:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787602377.330841:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787602377.330859:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500030800/0x3640686da09db058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602377.330867:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3500030800/0x3640686da09db058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602377.330875:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3500030800/0x3640686da09db058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602377.330887:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853606528:0@lo:101: 00000100:00100000:0.0:1787602377.330913:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602377.330933:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503df8240 going to sleep for 11 seconds 00000100:00100000:0.0:1787602377.330946:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853606528 00000100:00100000:0.0:1787602377.330949:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853606528 00000100:00100000:0.0:1787602377.330967:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787602377.330973:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:5834:x1874436853606528:12345-0@lo:101: 00010000:00010000:0.0:1787602377.330981:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602377.330998:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3500030e00/0x3640686da09db05f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db058 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602377.331026:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3500030e00/0x3640686da09db05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db058 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602377.331036:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3500030e00/0x3640686da09db05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db058 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602377.331044:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3500030e00, rc 0) 00000100:00100000:0.0:1787602377.331073:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853606528:12345-0@lo:101: Request processed in 100us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602377.331079:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787602377.331108:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853606528:0@lo:101: 00010000:00010000:0.0:1787602377.331118:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3500030800/0x3640686da09db058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db05f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602377.331126:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3500030800/0x3640686da09db058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db05f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602377.331168:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853606656:0@lo:501: 00000100:00100000:0.0:1787602377.331190:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602377.331203:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503df8240 going to sleep for 11 seconds 00000100:00100000:0.0:1787602377.331213:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853606656 00000100:00100000:0.0:1787602377.331215:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853606656 00000100:00100000:0.0:1787602377.331230:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787602377.331236:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853606656:12345-0@lo:501: 00000100:00100000:0.0:1787602377.331491:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853606656:12345-0@lo:501: Request processed in 253us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602377.331506:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787602377.331533:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853606656:0@lo:501: 00000100:00100000:0.0:1787602377.331570:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853606784:0@lo:503: 00000100:00100000:0.0:1787602377.331604:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602377.331835:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503df8240 going to sleep for 11 seconds 00000100:00100000:0.0:1787602377.331847:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853606784 00000100:00100000:0.0:1787602377.331851:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853606784 00000100:00100000:0.0:1787602377.331870:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787602377.331875:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853606784:12345-0@lo:503: 00000100:00100000:0.0:1787602377.332223:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853606784:12345-0@lo:503: Request processed in 346us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602377.332231:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787602377.332272:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853606784:0@lo:503: 00000100:00100000:1.0:1787602377.332658:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787602377.335184:0:6988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6988:1874436853606912:0@lo:502: 00000100:00100000:2.0:1787602377.335267:0:6988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602377.335319:0:6988:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3506b1d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602377.335579:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853606912 00000100:00100000:1.0:1787602377.335587:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853606912 00000100:00100000:1.0:1787602377.335704:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787602377.335715:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:6988:x1874436853606912:12345-0@lo:502: 00000100:00100000:1.0:1787602377.336516:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:6988:x1874436853606912:12345-0@lo:502: Request processed in 797us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602377.336529:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787602377.336717:0:6988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6988:1874436853606912:0@lo:502: 00000020:01000000:2.0:1787602377.336768:0:6988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787602377.336775:0:6988:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787602377.336783:0:6988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602377.336785:0:6988:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787602377.336790:0:6988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787602377.336795:0:6988:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.126@tcp to nid 0x20000c0a8c97e (192.168.201.126@tcp) 00000020:01000000:2.0:1787602377.336821:0:6988:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787602377.336824:0:6988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787602377.336840:0:6988:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d34049c0000) 00000020:00000080:2.0:1787602377.336861:0:6988:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787602377.336866:0:6988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787602377.336956:0:6988:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787602377.336962:0:6988:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787602377.336970:0:6988:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3640686da09db06d 00010000:00080000:2.0:1787602377.336999:0:6988:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d35271fa800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.126@tcp at head 00010000:00010000:2.0:1787602377.337299:0:6988:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:1.0:1787602377.392832:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787602377.394050:0:6988:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787602377.394075:0:6988:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787602377.395858:0:6988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787602377.396831:0:6988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787602377.397270:0:6988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787602377.397709:0:6988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787602377.400553:0:6991:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602377.400564:0:6991:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787602377.402913:0:6988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787602377.402933:0:6988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787602377.402979:0:6988:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787602377.403007:0:6988:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3640686da09db074 00000100:00080000:1.0:1787602377.403020:0:6988:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787602377.403027:0:6988:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d35271fa800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:1.0:1787602377.403075:0:6988:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d350886ea00 x1874436853607040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787602377.403220:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853607040:0@lo:8: 00000100:00100000:2.0:1787602377.403310:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787602377.403449:0:6988:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787602377.403526:0:6988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602377.403531:0:6988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602377.403533:0:6988:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787602377.403547:0:6988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787602377.403552:0:6988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602377.403553:0:6988:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787602377.403557:0:6988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787602377.403559:0:6988:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787602377.403586:0:6988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6988:1874436853607168:0@lo:502: 00000100:00100000:1.0:1787602377.403636:0:6988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602377.403656:0:6988:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3502fd8840 going to sleep for 11 seconds 00000100:00100000:1.0:1787602377.403730:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853607168 00000100:00100000:1.0:1787602377.403737:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853607168 00000100:00100000:1.0:1787602377.403807:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787602377.403817:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:6988:x1874436853607168:12345-0@lo:502: 00000100:00100000:1.0:1787602377.404058:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:6988:x1874436853607168:12345-0@lo:502: Request processed in 241us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602377.404066:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787602377.404150:0:6988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:6988:1874436853607168:0@lo:502: 00000020:01000000:1.0:1787602377.404177:0:6988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602377.404181:0:6988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602377.404183:0:6988:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787602377.404186:0:6988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1787602377.404413:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853607040 00000100:00100000:0.0:1787602377.404419:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853607040 00000100:00100000:0.0:1787602377.404443:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602377.404449:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1874436853607040:12345-0@lo:8: 00010000:00080000:0.0:1787602377.404471:0:6689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:0.0:1787602377.404501:0:6689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3640686da09db07b 00002000:00100000:0.0:1787602377.404549:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d3404328000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113951 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787602377.404554:0:6689:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787602377.404558:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787602377.404683:0:6689:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787602377.404854:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787602377.404881:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8d340432e000 : changing import state from RECOVER to FULL 00000020:01000000:1.0:1787602377.405533:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787602377.405582:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787602377.405592:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500030800/0x3640686da09db058 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db05f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602377.405614:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3500030800/0x3640686da09db058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db05f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602377.405626:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787602377.405629:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d350c9c3370 from 1 10000000:01000000:1.0:1787602377.405631:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787602377.405666:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20200/0x3640686da09db082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602377.405674:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3528f20200/0x3640686da09db082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602377.405683:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3528f20200/0x3640686da09db082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602377.405703:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853607552:0@lo:101: 00000100:00100000:1.0:1787602377.405764:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602377.405803:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3507937f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602377.405833:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853607552 00000100:00100000:1.0:1787602377.405839:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853607552 00000100:00100000:1.0:1787602377.405875:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787602377.405883:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:5834:x1874436853607552:12345-0@lo:101: 00010000:00010000:1.0:1787602377.405894:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602377.405908:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3528f21200/0x3640686da09db089 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db082 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602377.405932:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3528f21200/0x3640686da09db089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db082 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602377.405954:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3528f21200/0x3640686da09db089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db082 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602377.405965:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3528f21200, rc 0) 00000100:00100000:1.0:1787602377.405996:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853607552:12345-0@lo:101: Request processed in 113us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602377.406003:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787602377.406041:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853607552:0@lo:101: 00010000:00010000:1.0:1787602377.406054:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3528f20200/0x3640686da09db082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db089 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602377.406062:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3528f20200/0x3640686da09db082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db089 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602377.406120:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853607680:0@lo:501: 00000100:00100000:1.0:1787602377.406144:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602377.406158:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3507937f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602377.406172:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853607680 00000100:00100000:1.0:1787602377.406175:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853607680 00000100:00100000:1.0:1787602377.406195:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787602377.406201:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853607680:12345-0@lo:501: 00000100:00100000:3.0:1787602377.408072:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853607296:0@lo:400: 00000100:00100000:3.0:1787602377.408160:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602377.408228:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853607424:0@lo:400: 00000100:00100000:3.0:1787602377.408255:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602377.408437:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853607296 00000100:00100000:3.0:1787602377.408445:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853607296 00000100:00100000:3.0:1787602377.408484:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853607424 00000100:00100000:3.0:1787602377.408487:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853607424 00000100:00100000:3.0:1787602377.408505:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787602377.408514:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853607296:12345-0@lo:400: 00000100:00100000:3.0:1787602377.408591:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853607296:12345-0@lo:400: Request processed in 77us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602377.408599:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787602377.408617:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787602377.408623:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853607424:12345-0@lo:400: 00000100:00100000:3.0:1787602377.408655:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853607424:12345-0@lo:400: Request processed in 32us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602377.408660:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787602377.408704:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d350886f100 x1874436853607296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602377.408720:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853607296:0@lo:400: 00010000:00080000:3.0:1787602377.408780:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d350886f480 x1874436853607424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602377.408790:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853607424:0@lo:400: 00000100:00100000:1.0:1787602377.410418:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853607680:12345-0@lo:501: Request processed in 4204us (4260us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787602377.410432:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787602377.410503:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853607680:0@lo:501: 10000000:01000000:1.0:1787602377.411548:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787602377.411571:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20200/0x3640686da09db082 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db089 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602377.411584:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3528f20200/0x3640686da09db082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db089 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602377.417171:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1874436853607040:12345-0@lo:8: Request processed in 12706us (13846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602377.417185:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787602377.418827:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d350886ea00 x1874436853607040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787602387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602377.418843:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787602377.418857:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787602377.418865:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787602377.418872:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787602377.418876:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d35271fa800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787602377.418900:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787602377.418909:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853607040:0@lo:8: 00000004:00080000:2.0:1787602377.418958:0:6991:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787602377.419142:0:6991:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 162365398104ns, next at 0ns, rc = 0 00000004:00080000:2.0:1787602377.535346:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787602377.584615:0:6992:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787602377.585042:0:6992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6992:1874436853607936:0@lo:7: 00000100:00100000:1.0:1787602377.585129:0:6992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602377.585226:0:6992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3502fd8840 going to sleep for 11 seconds 00000100:00100000:0.0:1787602377.585275:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853607936 00000100:00100000:0.0:1787602377.585283:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853607936 00000100:00100000:3.0:1787602377.585502:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853607808:0@lo:13: 00000100:00100000:0.0:1787602377.585504:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602377.585515:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6992:x1874436853607936:12345-0@lo:7: 00000100:00100000:3.0:1787602377.585550:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602377.585594:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853607808 00000100:00100000:3.0:1787602377.585597:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853607808 00000100:00100000:3.0:1787602377.585621:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787602377.585627:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874436853607808:12345-0@lo:13: 00002000:00000024:3.0:1787602377.585661:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787602377.585709:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874436853607808:12345-0@lo:13: Request processed in 81us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602377.585715:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787602377.585770:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d350886d500 x1874436853607808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602377.585790:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853607808:0@lo:13: 00000100:00080000:1.0:1787602377.585963:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1787602377.592412:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787602377.592422:0:6691:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787602377.592616:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6992:x1874436853607936:12345-0@lo:7: Request processed in 7090us (7473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602377.592631:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787602377.592856:0:6992:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d350886c700 x1874436853607936/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787602393 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602377.592873:0:6992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6992:1874436853607936:0@lo:7: 00000004:00080000:0.0:1787602377.594560:0:6992:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787602377.594722:0:6992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6992:1874436853608064:0@lo:5: 00000100:00100000:2.0:1787602377.594812:0:6992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602377.595776:0:6992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3506b1d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787602377.598458:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853608064 00000100:00100000:0.0:1787602377.598476:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853608064 00000100:00100000:2.0:1787602377.598633:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787602377.598645:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6992:x1874436853608064:12345-0@lo:5: 00002000:00080000:2.0:1787602377.598682:0:6689:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787602377.598686:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787602377.599904:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6992:x1874436853608064:12345-0@lo:5: Request processed in 1256us (5091us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787602377.599913:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787602377.600459:0:6992:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3502f2f800 x1874436853608064/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787602393 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602377.600477:0:6992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6992:1874436853608064:0@lo:5: 00000004:00080000:0.0:1787602377.600491:0:6992:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787602377.600543:0:6992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6992:1874436853608192:0@lo:700: 00000100:00100000:0.0:1787602377.600585:0:6992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602377.600776:0:6992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35034b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1787602377.601141:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853608192 00000100:00100000:3.0:1787602377.601149:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853608192 00000100:00100000:3.0:1787602377.601314:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787602377.601324:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6992:x1874436853608192:12345-0@lo:700: 00000100:00100000:3.0:1787602377.601361:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534974000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6697:1874436853608320:0@lo:700: 00000100:00100000:3.0:1787602377.601560:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602377.601590:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3502ff5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602377.602439:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853608320 00000100:00100000:1.0:1787602377.602446:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853608320 00000100:00100000:1.0:1787602377.602492:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787602377.602500:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6697:x1874436853608320:12345-0@lo:700: 40000000:02000000:1.0:1787602377.641955:0:5843:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1787602377.647029:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6697:x1874436853608320:12345-0@lo:700: Request processed in 44521us (45460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602377.647044:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787602377.655490:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3534974000 x1874436853608320/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787602393 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602377.655510:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534974000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6697:1874436853608320:0@lo:700: 40000000:02000000:0.0:1787602377.655524:0:6697:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:2.0:1787602377.846234:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787602377.846270:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1787602377.851928:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6992:x1874436853608192:12345-0@lo:700: Request processed in 250593us (251329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602377.851964:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787602377.852052:0:6992:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3503e4c000 x1874436853608192/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787602393 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602377.852071:0:6992:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787602377.852090:0:6992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6992:1874436853608192:0@lo:700: 00000004:02000040:3.0:1787602377.916888:0:6992:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787602377.922277:0:6992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534975180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6992:1874436853608448:0@lo:5: 00000100:00100000:3.0:1787602377.922468:0:6992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602377.922588:0:6992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a4e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787602377.922783:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853608448 00000100:00100000:2.0:1787602377.922793:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853608448 00000100:00100000:2.0:1787602377.922850:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787602377.922861:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6992:x1874436853608448:12345-0@lo:5: 00002000:00080000:3.0:1787602377.933230:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787602377.933254:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787602377.945287:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6992:x1874436853608448:12345-0@lo:5: Request processed in 22418us (22810us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787602377.945306:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787602377.945480:0:6992:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3534975180 x1874436853608448/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787602393 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602377.945511:0:6992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534975180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6992:1874436853608448:0@lo:5: 00000004:00080000:0.0:1787602377.945540:0:6992:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787602378.413021:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787602378.910019:0:7059:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787602379.438241:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602380.460870:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602381.485031:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602382.445512:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853608960:0@lo:400: 00000100:00100000:1.0:1787602382.445591:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602382.445668:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787602382.445675:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853608832:0@lo:400: 00000100:00100000:1.0:1787602382.445708:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602382.445763:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853608960 00000100:00100000:1.0:1787602382.445773:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853608960 00000100:00100000:1.0:1787602382.445830:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787602382.445842:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874436853608960:12345-0@lo:400: 00000100:00100000:1.0:1787602382.445900:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874436853608960:12345-0@lo:400: Request processed in 62us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602382.445906:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787602382.445933:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853608832 00000100:00100000:1.0:1787602382.445937:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853608832 00000100:00100000:1.0:1787602382.445966:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787602382.445973:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853608832:12345-0@lo:400: 00000100:00100000:1.0:1787602382.446004:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853608832:12345-0@lo:400: Request processed in 32us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602382.446011:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1787602382.446026:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787602382.446378:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d350886ce00 x1874436853608832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602382.446392:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853608832:0@lo:400: 00010000:00080000:0.0:1787602382.446403:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d350886c000 x1874436853608960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602382.446411:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853608960:0@lo:400: 00000100:00100000:3.0:1787602382.446607:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853608576:0@lo:400: 00000100:00100000:3.0:1787602382.446639:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602382.446667:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602382.446680:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853608704:0@lo:400: 00000100:00100000:3.0:1787602382.446698:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602382.446719:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853608704 00000100:00100000:3.0:1787602382.446722:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853608704 00000100:00100000:3.0:1787602382.446738:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787602382.446758:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853608704:12345-0@lo:400: 00000100:00100000:3.0:1787602382.446783:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853608704:12345-0@lo:400: Request processed in 40us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602382.446787:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787602382.446804:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d350886fb80 x1874436853608704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602382.446810:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853608704:0@lo:400: 00000100:00100000:0.0:1787602382.446911:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853608576 00000100:00100000:0.0:1787602382.446914:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853608576 00000100:00100000:0.0:1787602382.446953:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787602382.446958:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:3301:x1874436853608576:12345-0@lo:400: 00000100:00100000:0.0:1787602382.446985:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:3301:x1874436853608576:12345-0@lo:400: Request processed in 27us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602382.446989:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787602382.447096:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853608576:0@lo:400: 00000100:00080000:1.0:1787602382.447674:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787602382.509641:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602382.970235:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853609088:0@lo:13: 00000100:00100000:0.0:1787602382.974123:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602382.974247:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853609088 00000100:00100000:0.0:1787602382.974256:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853609088 00000100:00100000:0.0:1787602382.974307:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602382.974318:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874436853609088:12345-0@lo:13: 00002000:00000024:0.0:1787602382.974375:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602382.974450:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874436853609088:12345-0@lo:13: Request processed in 125us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602382.974459:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787602382.974506:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3503e4d180 x1874436853609088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602382.974527:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853609088:0@lo:13: 00000001:00080000:0.0:1787602383.095503:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787602383.532885:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602384.556833:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602385.584122:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602386.606726:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602387.566968:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853609216:0@lo:400: 00000100:00100000:0.0:1787602387.567049:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602387.567144:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853609216 00000100:00100000:3.0:1787602387.567153:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853609216 00000100:00100000:3.0:1787602387.567203:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787602387.567213:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:3302:x1874436853609216:12345-0@lo:400: 00000100:00100000:3.0:1787602387.568935:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:3302:x1874436853609216:12345-0@lo:400: Request processed in 1718us (1880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602387.568946:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787602387.571446:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853609216:0@lo:400: 00000100:00100000:0.0:1787602387.571474:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602387.571486:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853609600:0@lo:400: 00000100:00100000:0.0:1787602387.571546:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602387.572315:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853609344:0@lo:400: 00000100:00100000:0.0:1787602387.572359:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602387.572399:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787602387.572406:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853609472:0@lo:400: 00000100:00100000:0.0:1787602387.572428:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602387.572604:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853609344 00000100:00100000:2.0:1787602387.572611:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853609344 00000100:00100000:2.0:1787602387.572655:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853609472 00000100:00100000:2.0:1787602387.572658:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853609472 00000100:00100000:2.0:1787602387.572687:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787602387.572695:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853609344:12345-0@lo:400: 00000100:00100000:2.0:1787602387.572789:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853609344:12345-0@lo:400: Request processed in 95us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602387.572797:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787602387.572814:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787602387.572820:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853609472:12345-0@lo:400: 00000100:00100000:2.0:1787602387.572846:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853609472:12345-0@lo:400: Request processed in 26us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602387.572851:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787602387.573144:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3502f2f800 x1874436853609472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602387.573160:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853609472:0@lo:400: 00010000:00080000:0.0:1787602387.573170:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3502f2c000 x1874436853609344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602387.573198:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853609344:0@lo:400: 00000100:00080000:0.0:1787602387.574022:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602387.574255:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853609600 00000100:00100000:1.0:1787602387.574262:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853609600 00000100:00100000:1.0:1787602387.574358:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602387.574380:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853609600:12345-0@lo:400: 00000100:00100000:1.0:1787602387.574471:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853609600:12345-0@lo:400: Request processed in 95us (2924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602387.574479:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787602387.574518:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3502f2f480 x1874436853609600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602387.574529:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787602387.574545:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853609600:0@lo:400: 00000100:00080000:0.0:1787602387.576896:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787602387.636324:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602388.081670:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853609728:0@lo:13: 00000100:00100000:0.0:1787602388.081771:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602388.082089:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853609728 00000100:00100000:0.0:1787602388.082097:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853609728 00000100:00100000:0.0:1787602388.082137:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787602388.082146:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853609728:12345-0@lo:13: 00002000:00000024:0.0:1787602388.082178:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602388.082222:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853609728:12345-0@lo:13: Request processed in 76us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602388.082228:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787602388.082284:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3503e4ce00 x1874436853609728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602388.082301:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853609728:0@lo:13: 00010000:00010000:1.0:1787602388.654112:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602389.678003:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602390.700945:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787602391.498699:0:7627:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787602391.498704:0:7627:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787602391.500184:0:7627:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d35271fb800 00000020:01000004:2.0:1787602391.500206:0:7627:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787602391.500221:0:7627:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787602391.500239:0:7627:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d34049c3370) 00000020:00000080:2.0:1787602391.500259:0:7627:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787602391.532208:0:7627:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787602391.541666:0:7627:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787602391.599215:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787602391.606513:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787602391.606553:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787602391.606627:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787602391.606649:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787602391.606998:0:7627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787602391.607011:0:7627:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787602391.607370:0:7627:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3640686da09db097 00000020:01000004:2.0:1787602391.607380:0:7627:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787602391.607404:0:7627:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787602391.607408:0:7627:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787602391.607415:0:7627:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787602391.607437:0:7627:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787602391.607441:0:7627:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787602391.631998:0:7627:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787602391.632104:0:7627:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.126@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787602391.632169:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787602391.632171:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787602391.632172:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602391.632173:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602391.632174:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602391.632175:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602391.632176:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787602391.632178:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787602391.632180:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787602391.632181:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602391.632182:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787602391.632186:0:7627:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787602391.632188:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787602391.632189:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787602391.632190:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602391.632191:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602391.632192:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602391.632193:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602391.632194:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787602391.632195:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787602391.632196:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787602391.632196:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602391.632202:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787602391.632235:0:7627:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787602391.632254:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853609856:0@lo:253: 00000100:00100000:2.0:1787602391.632361:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602391.632493:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32780 going to sleep for 11 seconds 00000100:00100000:3.0:1787602391.643524:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853609856 00000100:00100000:3.0:1787602391.643543:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853609856 00000100:00100000:3.0:1787602391.643724:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787602391.643737:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:7627:x1874436853609856:12345-0@lo:253: 20000000:01000000:3.0:1787602391.643793:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787602391.643798:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787602391.643819:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787602391.643823:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787602391.649901:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787602391.652532:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787602391.653646:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787602391.653736:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787602391.653771:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787602391.653804:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787602391.653865:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787602391.655321:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787602391.655349:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.126@tcp 20000000:01000000:3.0:1787602391.655351:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.126@tcp (null) (null) (null) 00000040:00080000:3.0:1787602391.655387:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787602391.655396:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787602391.655445:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787602391.655454:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.126@tcp (null) (null) 00000040:00080000:3.0:1787602391.655486:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787602391.655496:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787602391.655524:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787602391.656257:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787602391.660714:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787602391.661044:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.126@tcp 20000000:01000000:3.0:1787602391.661048:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.126@tcp (null) (null) (null) 00000040:00080000:3.0:1787602391.661326:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787602391.661337:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787602391.661369:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787602391.661377:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.126@tcp (null) (null) 00000040:00080000:3.0:1787602391.661408:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787602391.661418:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787602391.661513:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787602391.664215:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787602391.664271:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787602391.664289:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787602391.664305:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787602391.664322:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787602391.664324:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787602391.664375:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787602391.664378:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787602391.669771:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787602391.669877:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787602391.669936:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787602391.670535:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787602391.670582:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787602391.670620:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787602391.670632:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787602391.670636:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787602391.671619:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787602391.671940:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787602391.671986:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787602391.672219:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787602391.672232:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787602391.672234:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787602391.678509:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787602391.678601:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787602391.678658:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787602391.679052:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787602391.679117:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787602391.679205:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787602391.679220:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787602391.679223:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787602391.682962:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787602391.683244:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787602391.683282:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787602391.683931:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787602391.683987:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787602391.684073:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1787602391.684094:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787602391.684096:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787602391.684217:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787602391.684242:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3528f20600/0x3640686da09db09e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.684275:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3511046400/0x3640686da09dafef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dafe8 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.684283:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3503703a00/0x3640686da09db019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db012 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.684298:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3528f20800/0x3640686da09db043 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db03c expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.684307:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3500030e00/0x3640686da09db05f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db058 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.684315:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3528f21200/0x3640686da09db089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db082 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.684323:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3528f20600/0x3640686da09db09e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.684363:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3528f21200/0x3640686da09db089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db082 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.684377:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3528f21200/0x3640686da09db089 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db082 expref: 16 pid: 5832 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602391.684391:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874436853609984:0@lo:104: 00000100:00100000:1.0:1787602391.684463:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787602391.684589:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3500030e00/0x3640686da09db05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db058 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.684598:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3500030e00/0x3640686da09db05f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db058 expref: 16 pid: 5831 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602391.684612:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874436853610112:0@lo:104: 00010000:00010000:1.0:1787602391.684640:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3528f20800/0x3640686da09db043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db03c expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.684649:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3528f20800/0x3640686da09db043 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db03c expref: 16 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602391.684659:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874436853610240:0@lo:104: 00010000:00010000:1.0:1787602391.684687:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3503703a00/0x3640686da09db019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db012 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.684695:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3503703a00/0x3640686da09db019 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db012 expref: 16 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602391.684702:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874436853610368:0@lo:104: 00010000:00010000:1.0:1787602391.684723:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3511046400/0x3640686da09dafef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09dafe8 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.684732:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3511046400/0x3640686da09dafef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09dafe8 expref: 16 pid: 5832 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602391.684739:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874436853610496:0@lo:104: 00000100:00100000:1.0:1787602391.684791:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3529f54900 going to sleep for 11 seconds 00000100:00100000:3.0:1787602391.685395:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787602391.685418:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602391.685482:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602391.685531:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602391.685550:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853609984 00000100:00100000:1.0:1787602391.685618:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853609984 00000100:00100000:1.0:1787602391.685656:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853610112 00000100:00100000:1.0:1787602391.685659:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853610112 00000100:00100000:1.0:1787602391.685666:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853610240 00000100:00100000:1.0:1787602391.685677:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853610240 00000100:00100000:1.0:1787602391.685691:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787602391.685699:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3541302c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+5:5832:x1874436853609984:12345-0@lo:104: 00010000:00010000:1.0:1787602391.685711:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3528f20200/0x3640686da09db082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db089 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.685961:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602391.685968:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3541302c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+5:5832:x1874436853609984:12345-0@lo:104: Request processed in 270us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602391.685975:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787602391.686028:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787602391.686035:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+4:5832:x1874436853610112:12345-0@lo:104: 00010000:00010000:1.0:1787602391.686042:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3500030800/0x3640686da09db058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db05f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686074:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787602391.686079:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+4:5832:x1874436853610112:12345-0@lo:104: Request processed in 46us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602391.686084:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787602391.686095:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787602391.686101:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:5832:x1874436853610240:12345-0@lo:104: 00010000:00010000:1.0:1787602391.686117:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3500031800/0x3640686da09db03c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db043 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686144:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787602391.686148:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:5832:x1874436853610240:12345-0@lo:104: Request processed in 48us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602391.686154:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787602391.686179:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787602391.686185:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3528f20200/0x3640686da09db082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db089 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686193:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3528f20200 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602391.686196:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f20200/0x3640686da09db082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db089 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686205:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3528f20200/0x3640686da09db082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db089 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602391.686211:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f20200/0x3640686da09db082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db089 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602391.686217:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787602391.686249:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3528f20200/0x3640686da09db082 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db089 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686255:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602391.686273:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3528f20200/0x3640686da09db082 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db089 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686279:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3528f20200/0x3640686da09db082 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db089 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686288:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787602391.686301:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3500030800/0x3640686da09db058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db05f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686307:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3500030800 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602391.686309:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3500030800/0x3640686da09db058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db05f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686323:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3500030800/0x3640686da09db058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db05f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602391.686329:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3500030800/0x3640686da09db058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db05f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602391.686334:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787602391.686347:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3500030800/0x3640686da09db058 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db05f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686353:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602391.686357:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3500030800/0x3640686da09db058 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db05f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686363:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3500030800/0x3640686da09db058 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db05f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686373:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602391.686376:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3500031800/0x3640686da09db03c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db043 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686381:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3500031800 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602391.686384:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031800/0x3640686da09db03c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db043 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686390:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3500031800/0x3640686da09db03c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db043 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602391.686396:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031800/0x3640686da09db03c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db043 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602391.686406:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787602391.686419:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3500031800/0x3640686da09db03c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db043 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686425:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602391.686439:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3500031800/0x3640686da09db03c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db043 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686447:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3500031800/0x3640686da09db03c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db043 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686455:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602391.686456:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602391.686458:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602391.686477:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853610624:0@lo:103: 00000100:00100000:1.0:1787602391.686507:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602391.686539:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787602391.686545:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853610752:0@lo:103: 00000100:00100000:1.0:1787602391.686579:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602391.686605:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853610880:0@lo:103: 00000100:00100000:1.0:1787602391.686625:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602391.686655:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853610624 00000100:00100000:1.0:1787602391.686659:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853610624 00010000:00010000:1.0:1787602391.686678:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3528f21200/0x3640686da09db089 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db082 expref: 17 pid: 5832 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602391.686692:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853610752 00000100:00100000:1.0:1787602391.686694:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853610752 00010000:00010000:1.0:1787602391.686713:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3500030e00/0x3640686da09db05f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db058 expref: 18 pid: 5831 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602391.686724:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853610880 00000100:00100000:1.0:1787602391.686726:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853610880 00010000:00010000:1.0:1787602391.686777:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3528f20800/0x3640686da09db043 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db03c expref: 19 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602391.686792:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787602391.686798:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853610624:12345-0@lo:103: 00010000:00010000:1.0:1787602391.686808:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602391.686813:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3528f21200/0x3640686da09db089 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db082 expref: 19 pid: 5832 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686822:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3528f21200/0x3640686da09db089 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db082 expref: 19 pid: 5832 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686845:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602391.686874:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853610624:12345-0@lo:103: Request processed in 76us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602391.686879:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787602391.686892:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787602391.686898:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:3303:x1874436853610752:12345-0@lo:103: 00010000:00010000:1.0:1787602391.686905:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602391.686908:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3500030e00/0x3640686da09db05f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db058 expref: 18 pid: 5831 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686916:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3500030e00/0x3640686da09db05f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db058 expref: 18 pid: 5831 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686934:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602391.686955:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:3303:x1874436853610752:12345-0@lo:103: Request processed in 57us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602391.686960:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787602391.686971:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787602391.686976:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:3301:x1874436853610880:12345-0@lo:103: 00010000:00010000:1.0:1787602391.686983:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602391.686986:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3528f20800/0x3640686da09db043 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db03c expref: 17 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.686994:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3528f20800/0x3640686da09db043 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db03c expref: 17 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.687002:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602391.687025:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:3301:x1874436853610880:12345-0@lo:103: Request processed in 49us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602391.687030:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787602391.687063:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853610880:0@lo:103: 00000100:00100000:1.0:1787602391.687085:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853610752:0@lo:103: 00000100:00100000:1.0:1787602391.687092:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853610624:0@lo:103: 00010000:00010000:0.0:1787602391.687301:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602391.687448:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602391.687510:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853610368 00000100:00100000:1.0:1787602391.687514:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853610368 00000100:00100000:1.0:1787602391.687531:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853610496 00000100:00100000:1.0:1787602391.687533:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853610496 00000100:00100000:1.0:1787602391.687544:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787602391.687608:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+4:5832:x1874436853610368:12345-0@lo:104: 00010000:00010000:1.0:1787602391.687625:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db019 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.687704:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602391.687710:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+4:5832:x1874436853610368:12345-0@lo:104: Request processed in 161us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602391.687715:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787602391.687728:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787602391.687733:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:5832:x1874436853610496:12345-0@lo:104: 00010000:00010000:1.0:1787602391.687766:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09dafe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dafef expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602391.687846:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3528f21200/0x3640686da09db089 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db082 expref: 16 pid: 5832 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602391.687860:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874436853609984:0@lo:104: 00010000:00010000:2.0:1787602391.687869:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3500030e00/0x3640686da09db05f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db058 expref: 15 pid: 5831 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602391.687876:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874436853610112:0@lo:104: 00010000:00010000:2.0:1787602391.687885:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3528f20800/0x3640686da09db043 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db03c expref: 14 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602391.687892:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874436853610240:0@lo:104: 00000100:00100000:2.0:1787602391.687899:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874436853610368:0@lo:104: 00000100:00100000:2.0:1787602391.687905:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1874436853610496:0@lo:104: 00010000:00010000:2.0:1787602391.687925:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3528f20600/0x3640686da09db09e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602391.688095:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787602391.688101:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db019 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602391.688117:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3500031a00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:3.0:1787602391.688128:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db012 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db019 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602391.688135:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db019 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602391.688142:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db019 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602391.688148:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787602391.688198:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602391.688204:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534977100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:5832:x1874436853610496:12345-0@lo:104: Request processed in 471us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602391.688210:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787602391.688224:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602391.688400:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602391.688405:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09dafe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dafef expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.688413:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3511047000 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602391.688416:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09dafe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09dafef expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.688422:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09dafe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09dafef expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602391.688427:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09dafe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09dafef expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602391.688439:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787602391.688481:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db012 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db019 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602391.688487:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602391.688503:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db012 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db019 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602391.688510:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db012 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db019 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602391.688522:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602391.688524:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602391.688525:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602391.688538:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853611008:0@lo:103: 00000100:00100000:3.0:1787602391.688579:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602391.688623:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853611008 00000100:00100000:3.0:1787602391.688629:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853611008 00010000:00010000:3.0:1787602391.688648:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3503703a00/0x3640686da09db019 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db012 expref: 14 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602391.688671:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787602391.688684:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:3302:x1874436853611008:12345-0@lo:103: 00010000:00010000:3.0:1787602391.688695:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602391.688700:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3503703a00/0x3640686da09db019 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db012 expref: 14 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602391.688709:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3503703a00/0x3640686da09db019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db012 expref: 14 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602391.688721:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3503703a00/0x3640686da09db019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db012 expref: 14 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602391.688732:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602391.688777:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534974380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:3302:x1874436853611008:12345-0@lo:103: Request processed in 94us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602391.688783:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787602391.688812:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853611008:0@lo:103: 00010000:00010000:0.0:1787602391.692952:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602391.692960:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602391.693317:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09dafe8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dafef expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.693330:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602391.693363:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09dafe8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dafef expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.693372:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09dafe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dafef expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.693390:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602391.693392:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602391.693394:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602391.693430:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602391.693453:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853611136:0@lo:103: 00000100:00100000:3.0:1787602391.693531:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602391.695524:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853611136 00000100:00100000:1.0:1787602391.695539:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853611136 00010000:00010000:1.0:1787602391.695593:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3511046400/0x3640686da09dafef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dafe8 expref: 13 pid: 5832 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602391.695672:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787602391.695684:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534976300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:3304:x1874436853611136:12345-0@lo:103: 00010000:00010000:1.0:1787602391.695699:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602391.695705:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3511046400/0x3640686da09dafef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dafe8 expref: 13 pid: 5832 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.695718:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3511046400/0x3640686da09dafef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09dafe8 expref: 13 pid: 5832 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.695735:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3511046400/0x3640686da09dafef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09dafe8 expref: 13 pid: 5832 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.695785:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3528f20600/0x3640686da09db09e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.695794:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3528f20600/0x3640686da09db09e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.695811:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3528f20600/0x3640686da09db09e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.695819:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3528f20600/0x3640686da09db09e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.695826:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3528f20600/0x3640686da09db09e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.695834:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3528f20600/0x3640686da09db09e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.695841:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3528f20600 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602391.695846:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3528f20600/0x3640686da09db09e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.695855:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3528f20600/0x3640686da09db09e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.695875:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3528f20600/0x3640686da09db09e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.695886:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602391.695960:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534976300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:3304:x1874436853611136:12345-0@lo:103: Request processed in 278us (2428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602391.695977:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787602391.701136:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3528f20600/0x3640686da09db09e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.701155:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3528f20600/0x3640686da09db09e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.701178:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3528f20600/0x3640686da09db09e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787602391.701195:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787602391.706841:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853611136:0@lo:103: 00010000:00010000:0.0:1787602391.727187:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602391.787608:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:7627:x1874436853609856:12345-0@lo:253: Request processed in 143866us (155238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602391.787622:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787602391.787794:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853609856:0@lo:253: 10000000:01000000:2.0:1787602391.787809:0:7627:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787602391.787812:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787602391.787828:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787602391.787829:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602391.787831:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787602391.787832:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602391.787833:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602391.787835:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787602391.787837:0:7627:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787602391.787838:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602391.787840:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787602391.787858:0:7627:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d35271fb800 from lustre-OST0001 10000000:01000000:2.0:1787602391.787883:0:7627:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787602391.787885:0:7627:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787602391.787893:0:7627:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d350c9c3370 local copy 10000000:01000000:2.0:1787602391.787897:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787602391.787930:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503703c00/0x3640686da09db0a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602391.787940:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.126@tcp lock: ffff8d3503703c00/0x3640686da09db0a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602391.787949:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3503703c00/0x3640686da09db0a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602391.787967:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853611264:0@lo:101: 00000100:00100000:2.0:1787602391.788007:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602391.788063:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32180 going to sleep for 11 seconds 00000100:00100000:0.0:1787602391.788260:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853611264 00000100:00100000:0.0:1787602391.788266:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853611264 00000100:00100000:0.0:1787602391.788322:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787602391.788332:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:7627:x1874436853611264:12345-0@lo:101: 00010000:00010000:0.0:1787602391.788345:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602391.788357:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3500030c00/0x3640686da09db0ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db0a5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.788486:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3500030c00/0x3640686da09db0ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db0a5 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.788497:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3500030c00/0x3640686da09db0ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db0a5 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.788506:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3500030c00, rc 0) 00000100:00100000:0.0:1787602391.788543:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:7627:x1874436853611264:12345-0@lo:101: Request processed in 213us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602391.788614:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787602391.788695:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853611264:0@lo:101: 00010000:00010000:2.0:1787602391.788708:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3503703c00/0x3640686da09db0a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3640686da09db0ac expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602391.788718:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3503703c00/0x3640686da09db0a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3640686da09db0ac expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602391.788873:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853611392:0@lo:501: 00000100:00100000:2.0:1787602391.788914:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602391.788932:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32180 going to sleep for 11 seconds 00000100:00100000:0.0:1787602391.789000:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853611392 00000100:00100000:0.0:1787602391.789004:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853611392 00000100:00100000:0.0:1787602391.789499:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787602391.789508:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:7627:x1874436853611392:12345-0@lo:501: 00000100:00100000:0.0:1787602391.789886:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:7627:x1874436853611392:12345-0@lo:501: Request processed in 378us (969us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787602391.789894:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787602391.790004:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853611392:0@lo:501: 10000000:01000000:2.0:1787602391.790033:0:7627:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787602391.790065:0:7627:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787602391.790072:0:7627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503703c00/0x3640686da09db0a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3640686da09db0ac expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602391.790082:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503703c00/0x3640686da09db0a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3640686da09db0ac expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602391.790089:0:7627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff8d3503703c00/0x3640686da09db0a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3640686da09db0ac expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602391.790229:0:7627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787602391.790256:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d35271fb800 10000000:01000000:2.0:1787602391.790261:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787602391.790267:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787602391.790270:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787602391.790274:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787602391.790277:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787602391.790311:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503703e00/0x3640686da09db0b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602391.790320:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3503703e00/0x3640686da09db0b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602391.790340:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3503703e00/0x3640686da09db0b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602391.790356:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853611520:0@lo:101: 00000100:00100000:2.0:1787602391.790463:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602391.790549:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602391.790565:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3503703c00/0x3640686da09db0a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3640686da09db0ac expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.790574:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703c00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:0.0:1787602391.790578:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3503703c00/0x3640686da09db0a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3640686da09db0ac expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.790587:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3503703c00/0x3640686da09db0a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x3640686da09db0ac expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602391.790595:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3503703c00/0x3640686da09db0a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x3640686da09db0ac expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602391.790601:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602391.790621:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3503703c00/0x3640686da09db0a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3640686da09db0ac expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.790628:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602391.790649:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3503703c00/0x3640686da09db0a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3640686da09db0ac expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.790656:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3503703c00/0x3640686da09db0a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3640686da09db0ac expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.790682:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602391.790684:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602391.790686:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602391.790826:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602391.790840:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602391.790853:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853611648:0@lo:103: 00000100:00100000:2.0:1787602391.790880:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602391.790977:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853611648 00000100:00100000:0.0:1787602391.790982:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853611648 00000100:00100000:0.0:1787602391.791030:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602391.791039:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:3303:x1874436853611648:12345-0@lo:103: 00010000:00010000:0.0:1787602391.791050:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602391.791073:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3500030c00/0x3640686da09db0ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3640686da09db0a5 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.791087:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602391.791302:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:3303:x1874436853611648:12345-0@lo:103: Request processed in 253us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602391.791309:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602391.791511:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853611648:0@lo:103: 00000100:00100000:3.0:1787602391.791732:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853611520 00000100:00100000:3.0:1787602391.791738:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853611520 00000100:00100000:3.0:1787602391.791968:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787602391.791977:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+11:7627:x1874436853611520:12345-0@lo:101: 00010000:00010000:3.0:1787602391.791990:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602391.792007:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3511046e00/0x3640686da09db0ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db0b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602391.792039:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3511046e00/0x3640686da09db0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db0b3 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602391.792061:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3511046e00/0x3640686da09db0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db0b3 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602391.792069:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3511046e00, rc 0) 00000100:00100000:3.0:1787602391.792124:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:7627:x1874436853611520:12345-0@lo:101: Request processed in 149us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602391.792130:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787602391.792200:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853611520:0@lo:101: 00010000:00010000:2.0:1787602391.792215:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3503703e00/0x3640686da09db0b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db0ba expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602391.792225:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3503703e00/0x3640686da09db0b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db0ba expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602391.792336:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853611776:0@lo:501: 00000100:00100000:2.0:1787602391.792378:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602391.792705:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602391.792824:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853611776 00000100:00100000:1.0:1787602391.792830:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853611776 00000100:00100000:1.0:1787602391.792855:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787602391.792863:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:7627:x1874436853611776:12345-0@lo:501: 00000100:00100000:1.0:1787602391.793214:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:7627:x1874436853611776:12345-0@lo:501: Request processed in 351us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602391.793222:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787602391.793473:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853611776:0@lo:501: 00000100:00100000:2.0:1787602391.793507:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853611904:0@lo:503: 00000100:00100000:2.0:1787602391.793548:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602391.793648:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602391.793706:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853611904 00000100:00100000:1.0:1787602391.793712:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853611904 00000100:00100000:0.0:1787602391.793808:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787602391.793818:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:7627:x1874436853611904:12345-0@lo:503: 00000100:00100000:0.0:1787602391.793975:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:7627:x1874436853611904:12345-0@lo:503: Request processed in 159us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602391.793982:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787602391.794054:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853611904:0@lo:503: 00000040:00080000:2.0:1787602391.794516:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787602391.794591:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853612032:0@lo:502: 00000100:00100000:2.0:1787602391.794631:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602391.795425:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787602391.795538:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853612032 00000100:00100000:3.0:1787602391.795546:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853612032 00000100:00100000:3.0:1787602391.795583:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787602391.795592:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:7627:x1874436853612032:12345-0@lo:502: 00000100:00100000:3.0:1787602391.795814:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:7627:x1874436853612032:12345-0@lo:502: Request processed in 222us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602391.795821:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787602391.795919:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853612032:0@lo:502: 00000040:00080000:2.0:1787602391.798281:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787602391.798393:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787602391.798432:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787602391.798494:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787602391.798546:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787602391.798582:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787602391.798628:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853612160:0@lo:502: 00000100:00100000:2.0:1787602391.798698:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602391.798734:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787602391.798944:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853612160 00000100:00100000:3.0:1787602391.798952:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853612160 00000100:00100000:3.0:1787602391.798990:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787602391.798998:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:7627:x1874436853612160:12345-0@lo:502: 00000100:00100000:3.0:1787602391.799320:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:7627:x1874436853612160:12345-0@lo:502: Request processed in 321us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602391.799328:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787602391.799532:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853612160:0@lo:502: 00000040:00080000:2.0:1787602391.799617:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787602391.799626:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787602391.800306:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787602391.800314:0:7635:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787602391.800321:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602391.800324:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787602391.800330:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787602391.800346:0:7635:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d353d7919b8) 00000020:00000080:0.0:1787602391.800377:0:7635:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787602391.800392:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787602391.800456:0:7635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d35271fb800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787602391.800464:0:7635:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787602391.800470:0:7635:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3640686da09db0c8 00010000:00010000:0.0:1787602391.806698:0:7635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1787602391.807508:0:7635:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787602391.812915:0:7635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787602391.813599:0:7635:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787602391.819876:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787602391.820532:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787602391.823863:0:7635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787602391.823877:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602391.823883:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602391.823886:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787602391.823890:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787602391.823893:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602391.823895:0:7635:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787602391.823898:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787602391.823900:0:7635:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787602391.823955:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602391.823958:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602391.823959:0:7635:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787602391.823962:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787602391.824241:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787602391.824267:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787602391.824331:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503703e00/0x3640686da09db0b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db0ba expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602391.824345:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3503703e00/0x3640686da09db0b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db0ba expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602391.824377:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d35271fb800 from 1 10000000:01000000:3.0:1787602391.824380:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787602391.824415:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3511047600/0x3640686da09db0cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602391.824423:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3511047600/0x3640686da09db0cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602391.824435:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3511047600/0x3640686da09db0cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602391.824458:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853612288:0@lo:101: 00000100:00100000:3.0:1787602391.824525:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602391.824578:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3536ba6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602391.825132:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853612288 00000100:00100000:1.0:1787602391.825141:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853612288 00000100:00100000:1.0:1787602391.825196:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787602391.825206:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:7627:x1874436853612288:12345-0@lo:101: 00010000:00010000:1.0:1787602391.825217:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602391.825239:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3528f20200/0x3640686da09db0d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db0cf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.825261:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3528f20200/0x3640686da09db0d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db0cf expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.825271:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3528f20200/0x3640686da09db0d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db0cf expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.825279:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3528f20200, rc 0) 00000100:00100000:1.0:1787602391.825328:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:7627:x1874436853612288:12345-0@lo:101: Request processed in 124us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602391.825335:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787602391.826912:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853612288:0@lo:101: 00010000:00010000:3.0:1787602391.826939:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3511047600/0x3640686da09db0cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db0d6 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602391.826952:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3511047600/0x3640686da09db0cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db0d6 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602391.827206:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853612416:0@lo:501: 00000100:00100000:3.0:1787602391.827262:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602391.827310:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3536ba6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602391.828815:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853612416 00000100:00100000:1.0:1787602391.828827:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853612416 00000100:00100000:1.0:1787602391.828879:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787602391.828889:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:7627:x1874436853612416:12345-0@lo:501: 00000100:00100000:1.0:1787602391.829320:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:7627:x1874436853612416:12345-0@lo:501: Request processed in 431us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602391.829328:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787602391.831509:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853612416:0@lo:501: 00000100:00100000:3.0:1787602391.831565:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853612544:0@lo:503: 00000100:00100000:3.0:1787602391.831634:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602391.831679:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3536ba6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787602391.831739:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853612544 00000100:00100000:0.0:1787602391.831768:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853612544 00000100:00100000:0.0:1787602391.831811:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787602391.831820:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:7627:x1874436853612544:12345-0@lo:503: 00000100:00100000:0.0:1787602391.832519:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:7627:x1874436853612544:12345-0@lo:503: Request processed in 698us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602391.832528:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787602391.832615:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853612544:0@lo:503: 00000040:00080000:3.0:1787602391.832932:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787602391.832995:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853612672:0@lo:502: 00000100:00100000:3.0:1787602391.833034:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602391.833076:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3536ba6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787602391.833848:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853612672 00000100:00100000:0.0:1787602391.833857:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853612672 00000100:00100000:0.0:1787602391.833901:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787602391.833909:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:7627:x1874436853612672:12345-0@lo:502: 00000100:00100000:0.0:1787602391.834436:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:7627:x1874436853612672:12345-0@lo:502: Request processed in 526us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602391.834444:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787602391.834824:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853612672:0@lo:502: 00000040:00080000:3.0:1787602391.836031:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787602391.836236:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787602391.836279:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853612800:0@lo:502: 00000100:00100000:3.0:1787602391.836352:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602391.836461:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3536ba6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787602391.836593:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853612800 00000100:00100000:0.0:1787602391.836600:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853612800 00000100:00100000:0.0:1787602391.836649:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787602391.836660:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:7627:x1874436853612800:12345-0@lo:502: 00000100:00100000:0.0:1787602391.836866:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:7627:x1874436853612800:12345-0@lo:502: Request processed in 207us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602391.836880:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787602391.836963:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853612800:0@lo:502: 00000040:00080000:2.0:1787602391.837094:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787602391.837203:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787602391.838831:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602391.838844:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602391.838847:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787602391.838853:0:7639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d35271fb800 00000020:00000080:2.0:1787602391.838856:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787602391.838876:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602391.838880:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602391.838881:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787602391.838894:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787602391.839037:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787602391.839069:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602391.839093:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3511047600/0x3640686da09db0cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db0d6 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.839113:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3511047600/0x3640686da09db0cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db0d6 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602391.839156:0:7627:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787602391.839160:0:7627:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d35271fb800 10000000:01000000:0.0:1787602391.839163:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d35271fb800 10000000:01000000:0.0:1787602391.839166:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787602391.839173:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d35271fb800 from 1 10000000:01000000:0.0:1787602391.839176:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787602391.839209:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500030c00/0x3640686da09db0dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.839219:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3500030c00/0x3640686da09db0dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.839231:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3500030c00/0x3640686da09db0dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602391.839252:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853612928:0@lo:101: 00000100:00100000:0.0:1787602391.839417:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602391.839447:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a0b43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602391.839471:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853612928 00000100:00100000:0.0:1787602391.839477:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853612928 00000100:00100000:0.0:1787602391.839523:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787602391.839533:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:7627:x1874436853612928:12345-0@lo:101: 00010000:00010000:0.0:1787602391.839546:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602391.839559:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3500031e00/0x3640686da09db0e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db0dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.839582:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3500031e00/0x3640686da09db0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db0dd expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.839592:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3500031e00/0x3640686da09db0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db0dd expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.839601:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3500031e00, rc 0) 00000100:00100000:0.0:1787602391.839635:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:7627:x1874436853612928:12345-0@lo:101: Request processed in 104us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602391.839642:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787602391.839688:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853612928:0@lo:101: 00010000:00010000:0.0:1787602391.839702:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3500030c00/0x3640686da09db0dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db0e4 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.839711:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3500030c00/0x3640686da09db0dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db0e4 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602391.839818:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853613056:0@lo:501: 00000100:00100000:0.0:1787602391.839846:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602391.839859:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a0b43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602391.839870:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853613056 00000100:00100000:0.0:1787602391.839874:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853613056 00000100:00100000:0.0:1787602391.839894:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787602391.839906:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:7627:x1874436853613056:12345-0@lo:501: 00000100:00100000:0.0:1787602391.840127:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:7627:x1874436853613056:12345-0@lo:501: Request processed in 222us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602391.840134:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787602391.840166:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853613056:0@lo:501: 00000100:00100000:0.0:1787602391.840189:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853613184:0@lo:503: 00000100:00100000:0.0:1787602391.840226:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602391.840239:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a0b43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602391.840250:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853613184 00000100:00100000:0.0:1787602391.840254:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853613184 00000100:00100000:0.0:1787602391.840275:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787602391.840282:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:7627:x1874436853613184:12345-0@lo:503: 00000100:00100000:0.0:1787602391.840440:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:7627:x1874436853613184:12345-0@lo:503: Request processed in 158us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602391.840446:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787602391.840485:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853613184:0@lo:503: 00000040:00080000:0.0:1787602391.840738:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787602391.840805:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853613312:0@lo:502: 00000100:00100000:0.0:1787602391.840844:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602391.840861:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353ca93240 going to sleep for 11 seconds 00000100:00100000:0.0:1787602391.840875:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853613312 00000100:00100000:0.0:1787602391.840879:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853613312 00000100:00100000:0.0:1787602391.840901:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787602391.840908:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:7627:x1874436853613312:12345-0@lo:502: 00000100:00100000:0.0:1787602391.841066:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:7627:x1874436853613312:12345-0@lo:502: Request processed in 158us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602391.841094:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787602391.841133:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853613312:0@lo:502: 00000040:00080000:0.0:1787602391.841392:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787602391.841440:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787602391.841475:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787602391.841522:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787602391.841560:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787602391.841620:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787602391.841659:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787602391.841694:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787602391.841771:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787602391.841810:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787602391.841847:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787602391.841895:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787602391.841931:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787602391.841981:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787602391.842030:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787602391.848216:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787602391.848321:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787602391.848784:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787602391.848832:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787602391.848865:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787602391.848907:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787602391.848944:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787602391.848978:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787602391.849037:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787602391.849072:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787602391.849181:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787602391.849237:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787602391.849272:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787602391.849321:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787602391.849581:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787602391.849619:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787602391.849654:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787602391.849688:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787602391.849849:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787602391.849888:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787602391.849935:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787602391.849968:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787602391.850089:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853613440:0@lo:502: 00000100:00100000:0.0:1787602391.850503:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602391.850733:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353ca93240 going to sleep for 11 seconds 00000100:00100000:1.0:1787602391.856172:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853613440 00000100:00100000:1.0:1787602391.856188:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853613440 00000100:00100000:3.0:1787602391.857627:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787602391.857649:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:7627:x1874436853613440:12345-0@lo:502: 00000100:00100000:3.0:1787602391.857985:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:7627:x1874436853613440:12345-0@lo:502: Request processed in 345us (7481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602391.857994:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787602391.858160:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853613440:0@lo:502: 00000040:00080000:1.0:1787602391.858276:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1787602391.858318:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787602391.859121:0:7640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787602391.859138:0:7640:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d34049c19b8) 00000020:00000080:2.0:1787602391.859159:0:7640:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1787602391.859245:0:7640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d35271fb800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787602391.859249:0:7640:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d35271fb800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787602391.859252:0:7640:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d35271fb800 3 00010000:00080000:2.0:1787602391.859284:0:7640:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d3405c71800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.126@tcp at head 00010000:00010000:2.0:1787602391.861655:0:7640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1787602391.861883:0:7640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787602391.861917:0:7640:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787602391.861928:0:7640:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3640686da09db0f2 00000100:00080000:2.0:1787602391.861937:0:7640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787602391.861942:0:7640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d3405c71800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:2.0:1787602391.861987:0:7640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3502f2ea00 x1874436853613568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787602391.866278:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1874436853613568:0@lo:38: 00000100:00100000:2.0:1787602391.867521:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787602391.867607:0:7640:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787602391.867709:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853613952:0@lo:400: 00000100:00100000:2.0:1787602391.867763:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602391.867805:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853613952 00000100:00100000:2.0:1787602391.867813:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853613952 00000100:00100000:2.0:1787602391.867871:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787602391.867880:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853613952:12345-0@lo:400: 00000100:00100000:2.0:1787602391.867934:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853613952:12345-0@lo:400: Request processed in 55us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602391.867941:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787602391.867979:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787602391.868008:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3502f2d180 x1874436853613952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602391.868265:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853613568 00000100:00100000:3.0:1787602391.868269:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853613568 00000100:00100000:3.0:1787602391.868307:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602391.868312:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1874436853613568:12345-0@lo:38: 00010000:00080000:3.0:1787602391.868338:0:5836:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:3.0:1787602391.868436:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3640686da09db0f9 00000004:00100000:3.0:1787602391.868453:0:5836:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787602391.868488:0:5836:0:(import.c:65:import_set_state_nolock()) ffff8d3534812800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787602391.868547:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874436853613568:12345-0@lo:38: Request processed in 233us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602391.868554:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602391.868576:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853613696:0@lo:400: 00000100:00100000:3.0:1787602391.868603:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602391.868626:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602391.868633:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874436853613824:0@lo:400: 00000100:00100000:3.0:1787602391.868654:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602391.868685:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853613696 00000100:00100000:3.0:1787602391.868688:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853613696 00000100:00100000:3.0:1787602391.868707:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853613824 00000100:00100000:3.0:1787602391.868710:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853613824 00000100:00100000:3.0:1787602391.868733:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787602391.868739:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853613696:12345-0@lo:400: 00000100:00100000:3.0:1787602391.868792:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853613696:12345-0@lo:400: Request processed in 53us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602391.868798:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787602391.868810:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787602391.868816:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874436853613824:12345-0@lo:400: 00000100:00100000:3.0:1787602391.868843:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874436853613824:12345-0@lo:400: Request processed in 27us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602391.868848:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787602391.868865:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787602391.868881:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3502f2dc00 x1874436853613824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602391.868894:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874436853613824:0@lo:400: 00010000:00080000:3.0:1787602391.868903:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3502f2ca80 x1874436853613696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602391.868917:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853613696:0@lo:400: 00010000:00080000:3.0:1787602391.868947:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3502f2ea00 x1874436853613568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787602401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602391.868954:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787602391.868960:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787602391.868966:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787602391.868970:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787602391.868973:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d3405c71800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787602391.868978:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1874436853613568:0@lo:38: 00000100:00100000:2.0:1787602391.871235:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853613952:0@lo:400: 00000040:00080000:3.0:1787602391.874732:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1787602391.875405:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4fb80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1874436853614080:0@lo:901: 00000100:00100000:0.0:1787602391.875486:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602391.875527:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a0b43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602391.875631:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853614080 00000100:00100000:2.0:1787602391.875639:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853614080 00000100:00100000:2.0:1787602391.875703:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602391.875713:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1874436853614080:12345-0@lo:901: 00000100:00100000:2.0:1787602391.876252:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1874436853614080:12345-0@lo:901: Request processed in 538us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602391.876260:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787602391.876313:0:7642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3503e4fb80 x1874436853614080/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787602407 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602391.876327:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4fb80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1874436853614080:0@lo:901: 00000100:00080000:0.0:1787602391.876529:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:0.0:1787602391.877220:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787602391.877252:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787602391.877274:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500030c00/0x3640686da09db0dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db0e4 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.877284:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3500030c00/0x3640686da09db0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db0e4 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787602391.877339:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787602391.877341:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787602391.877343:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787602391.877344:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787602391.877346:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787602391.877347:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787602391.877349:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787602391.877350:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787602391.877352:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787602391.877423:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787602391.877425:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787602391.877429:0:7627:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787602391.877431:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787602391.877432:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787602391.877433:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787602391.877434:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787602391.877435:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787602391.877436:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787602391.877437:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787602391.877438:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787602391.877439:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787602391.877440:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787602391.877441:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787602391.877462:0:7627:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787602391.877478:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853614208:0@lo:253: 00000100:00100000:0.0:1787602391.877529:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602391.877572:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3507937180 going to sleep for 11 seconds 00000100:00100000:3.0:1787602391.877656:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853614208 00000100:00100000:3.0:1787602391.877663:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853614208 00000100:00100000:3.0:1787602391.877704:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787602391.877713:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:7627:x1874436853614208:12345-0@lo:253: 20000000:01000000:3.0:1787602391.877736:0:5829:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787602391.877801:0:5829:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787602391.927779:0:5829:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787602391.927799:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787602391.927856:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787602391.927860:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787602391.927884:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3528f20600/0x3640686da09db100 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.927923:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3528f20c00/0x3640686da09db051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db04a expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.927931:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3528f20600/0x3640686da09db100 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.927976:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3528f20c00/0x3640686da09db051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db04a expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602391.927990:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3528f20c00/0x3640686da09db051 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db04a expref: 14 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602391.928004:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874436853614336:0@lo:104: 00000100:00100000:1.0:1787602391.928085:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602391.928140:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3536ba6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787602391.928257:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853614336 00000100:00100000:0.0:1787602391.928267:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853614336 00000100:00100000:0.0:1787602391.928335:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787602391.928346:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:5852:x1874436853614336:12345-0@lo:104: 00010000:00010000:0.0:1787602391.928367:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3500030400/0x3640686da09db04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db051 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.928429:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787602391.928435:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:5852:x1874436853614336:12345-0@lo:104: Request processed in 91us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602391.928442:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787602391.928464:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602391.928470:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3500030400/0x3640686da09db04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db051 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.928489:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3500030400 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:0.0:1787602391.928494:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3500030400/0x3640686da09db04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db051 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.928503:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3500030400/0x3640686da09db04a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db051 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602391.928511:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3500030400/0x3640686da09db04a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db051 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602391.928517:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602391.928541:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3500030400/0x3640686da09db04a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db051 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.928547:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602391.928561:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3500030400/0x3640686da09db04a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db051 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.928567:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3500030400/0x3640686da09db04a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db051 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.928582:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602391.928584:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602391.928586:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602391.928606:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874436853614336:0@lo:104: 00010000:00010000:0.0:1787602391.928622:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3528f20600/0x3640686da09db100 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602391.928806:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853614464:0@lo:103: 00000100:00100000:2.0:1787602391.928838:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602391.930295:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853614464 00000100:00100000:0.0:1787602391.930318:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853614464 00010000:00010000:0.0:1787602391.930346:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3528f20c00/0x3640686da09db051 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db04a expref: 15 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602391.930382:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787602391.930391:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3509d57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:3304:x1874436853614464:12345-0@lo:103: 00010000:00010000:0.0:1787602391.930403:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602391.930407:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3528f20c00/0x3640686da09db051 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db04a expref: 15 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.930419:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3528f20c00/0x3640686da09db051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db04a expref: 15 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.930434:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3528f20c00/0x3640686da09db051 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db04a expref: 15 pid: 5829 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.930449:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3528f20600/0x3640686da09db100 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.930457:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3528f20600/0x3640686da09db100 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787602391.930471:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002611526s 00010000:00010000:0.0:1787602391.930475:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3528f20600/0x3640686da09db100 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.930483:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3528f20600/0x3640686da09db100 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.930490:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3528f20600/0x3640686da09db100 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.930506:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3528f20600/0x3640686da09db100 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.930512:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3528f20600 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602391.930516:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3528f20600/0x3640686da09db100 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.930524:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3528f20600/0x3640686da09db100 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.930536:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3528f20600/0x3640686da09db100 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.930545:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602391.930590:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3509d57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:3304:x1874436853614464:12345-0@lo:103: Request processed in 200us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602391.930597:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787602391.930654:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853614464:0@lo:103: 00010000:00010000:0.0:1787602391.930675:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3528f20600/0x3640686da09db100 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.930683:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3528f20600/0x3640686da09db100 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602391.930690:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3528f20600/0x3640686da09db100 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602391.940778:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:7627:x1874436853614208:12345-0@lo:253: Request processed in 63030us (63212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602391.940807:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787602391.941002:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:7627:1874436853614208:0@lo:253: 10000000:01000000:2.0:1787602391.941251:0:7627:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787602391.941254:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787602391.941256:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787602391.941257:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602391.941258:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602391.941259:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602391.941260:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602391.941262:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787602391.941263:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787602391.941264:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787602391.941266:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602391.941268:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787602391.941300:0:7627:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787602391.951978:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787602391.952193:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787602391.952426:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787602391.952598:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787602391.952832:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787602391.953058:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787602391.954931:0:7627:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787602392.260037:0:7627:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787602392.260046:0:7627:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787602392.260188:0:7627:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787602392.260261:0:7627:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.126@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787602392.260276:0:7627:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787602392.260318:0:7627:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787602392.748927:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602393.199888:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787602393.199916:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853614592:0@lo:13: 00000100:00100000:3.0:1787602393.199995:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602393.200102:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853614592 00000100:00100000:0.0:1787602393.200122:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853614592 00000100:00100000:0.0:1787602393.200185:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787602393.200195:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853614592:12345-0@lo:13: 00002000:00000024:0.0:1787602393.200232:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602393.200291:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853614592:12345-0@lo:13: Request processed in 97us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602393.200299:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787602393.200349:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534975180 x1874436853614592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602393.200367:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853614592:0@lo:13: 00000100:00080000:3.0:1787602393.200526:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787602393.773220:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602394.796844:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602395.821466:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602396.845412:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602397.296972:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853614720:0@lo:400: 00000100:00100000:3.0:1787602397.297067:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602397.297117:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853615232:0@lo:400: 00000100:00100000:3.0:1787602397.297145:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602397.297170:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787602397.297176:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853615104:0@lo:400: 00000100:00100000:3.0:1787602397.297213:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602397.297244:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853614976:0@lo:400: 00000100:00100000:3.0:1787602397.297266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602397.297283:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602397.297288:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874436853614848:0@lo:400: 00000100:00100000:3.0:1787602397.297309:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602397.297335:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853614720 00000100:00100000:3.0:1787602397.297343:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853614720 00000100:00100000:3.0:1787602397.297386:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787602397.297409:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:3302:x1874436853614720:12345-0@lo:400: 00000100:00100000:3.0:1787602397.297456:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:3302:x1874436853614720:12345-0@lo:400: Request processed in 63us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602397.297463:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787602397.297492:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853615232 00000100:00100000:3.0:1787602397.297496:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853615232 00000100:00100000:3.0:1787602397.297523:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853614976 00000100:00100000:3.0:1787602397.297526:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853614976 00000100:00100000:3.0:1787602397.297537:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853614848 00000100:00100000:3.0:1787602397.297539:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853614848 00000100:00100000:3.0:1787602397.297608:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787602397.297616:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853615232:12345-0@lo:400: 00000100:00100000:3.0:1787602397.297649:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853615232:12345-0@lo:400: Request processed in 35us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602397.297655:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787602397.297667:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787602397.297673:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853614976:12345-0@lo:400: 00000100:00100000:3.0:1787602397.297702:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853614976:12345-0@lo:400: Request processed in 29us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602397.297707:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787602397.297717:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787602397.297722:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874436853614848:12345-0@lo:400: 00000100:00100000:3.0:1787602397.297772:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874436853614848:12345-0@lo:400: Request processed in 50us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602397.297779:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787602397.297831:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853615104 00000100:00100000:3.0:1787602397.297835:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853615104 00000100:00100000:3.0:1787602397.297865:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602397.297872:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853615104:12345-0@lo:400: 00000100:00100000:3.0:1787602397.297905:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853615104:12345-0@lo:400: Request processed in 34us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602397.297910:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787602397.297950:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d34074cb100 x1874436853615104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602397.297964:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853615104:0@lo:400: 00000100:00100000:3.0:1787602397.297974:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853614720:0@lo:400: 00010000:00080000:3.0:1787602397.297992:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d34074cb480 x1874436853615232/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602397.298000:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853615232:0@lo:400: 00000100:00080000:3.0:1787602397.298024:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787602397.298028:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787602397.298041:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534975180 x1874436853614848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602397.298051:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874436853614848:0@lo:400: 00010000:00080000:3.0:1787602397.298060:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d34074c9500 x1874436853614976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602397.298067:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853614976:0@lo:400: 00010000:00010000:0.0:1787602397.875343:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602398.322160:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853615360:0@lo:13: 00000100:00100000:1.0:1787602398.322264:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602398.322348:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853615360 00000100:00100000:1.0:1787602398.322356:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853615360 00000100:00100000:1.0:1787602398.322403:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787602398.322413:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853615360:12345-0@lo:13: 00002000:00000024:1.0:1787602398.322448:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602398.322506:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853615360:12345-0@lo:13: Request processed in 94us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602398.322528:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787602398.322571:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d350886ed80 x1874436853615360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602398.322589:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853615360:0@lo:13: 00010000:00010000:0.0:1787602398.894368:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787602399.330530:0:7984:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787602399.937783:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787602400.881447:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787602400.881468:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d353d79c800 from 30 10000000:01000000:3.0:1787602400.881474:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787602400.881524:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3511046400/0x3640686da09db107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602400.881537:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3511046400/0x3640686da09db107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602400.881549:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3511046400/0x3640686da09db107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602400.881573:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853615488:0@lo:101: 00000100:00100000:3.0:1787602400.881641:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602400.881701:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503365cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602400.886326:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853615488 00000100:00100000:0.0:1787602400.886342:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853615488 00000100:00100000:0.0:1787602400.886407:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787602400.886418:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:5834:x1874436853615488:12345-0@lo:101: 00010000:00010000:0.0:1787602400.886436:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602400.886454:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3500031600/0x3640686da09db10e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db107 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602400.886498:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3500031600/0x3640686da09db10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db107 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602400.886510:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3500031600/0x3640686da09db10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db107 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602400.886519:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3500031600, rc 0) 00000100:00100000:0.0:1787602400.886607:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:5834:x1874436853615488:12345-0@lo:101: Request processed in 191us (4966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602400.886614:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787602400.886877:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853615488:0@lo:101: 00010000:00010000:2.0:1787602400.886896:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3511046400/0x3640686da09db107 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db10e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602400.886906:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3511046400/0x3640686da09db107 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db10e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602400.886979:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853615616:0@lo:501: 00000100:00100000:2.0:1787602400.887015:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602400.887059:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35034b6840 going to sleep for 11 seconds 00000100:00100000:3.0:1787602400.888334:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853615616 00000100:00100000:3.0:1787602400.888359:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853615616 00000100:00100000:3.0:1787602400.888420:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787602400.888431:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:5834:x1874436853615616:12345-0@lo:501: 00000100:00100000:3.0:1787602400.888843:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:5834:x1874436853615616:12345-0@lo:501: Request processed in 413us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602400.889043:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787602400.889098:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853615616:0@lo:501: 00000100:00100000:3.0:1787602400.889158:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853615744:0@lo:503: 00000100:00100000:3.0:1787602400.889275:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602400.889308:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35033656c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602400.889321:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853615744 00000100:00100000:3.0:1787602400.889325:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853615744 00000100:00100000:3.0:1787602400.889346:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787602400.889352:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:5834:x1874436853615744:12345-0@lo:503: 00000100:00100000:3.0:1787602400.890339:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:5834:x1874436853615744:12345-0@lo:503: Request processed in 982us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602400.890349:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787602400.895711:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853615744:0@lo:503: 00000100:00100000:1.0:1787602400.898616:0:8057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8057:1874436853615872:0@lo:502: 00000100:00100000:1.0:1787602400.898707:0:8057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602400.898788:0:8057:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602400.898873:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853615872 00000100:00100000:2.0:1787602400.898881:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853615872 00000100:00100000:2.0:1787602400.898922:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787602400.898931:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:8057:x1874436853615872:12345-0@lo:502: 00000100:00100000:2.0:1787602400.899249:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:8057:x1874436853615872:12345-0@lo:502: Request processed in 318us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602400.899257:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787602400.899705:0:8057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8057:1874436853615872:0@lo:502: 00000100:00100000:1.0:1787602400.899786:0:8057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8057:1874436853616000:0@lo:502: 00000100:00100000:1.0:1787602400.899820:0:8057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602400.899889:0:8057:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787602400.902046:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853616000 00000100:00100000:3.0:1787602400.902101:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853616000 00000100:00100000:3.0:1787602400.902180:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787602400.902190:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:8057:x1874436853616000:12345-0@lo:502: 00000100:00100000:3.0:1787602400.902492:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:8057:x1874436853616000:12345-0@lo:502: Request processed in 303us (2670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602400.902500:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787602400.902711:0:8057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8057:1874436853616000:0@lo:502: 00000040:00080000:1.0:1787602400.902763:0:8057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787602400.902991:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787602400.903013:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787602400.903023:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3511046400/0x3640686da09db107 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db10e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602400.903033:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3511046400/0x3640686da09db107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db10e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602400.903042:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787602400.903053:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787602400.903055:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787602400.903085:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503702a00/0x3640686da09db115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602400.903093:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3503702a00/0x3640686da09db115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602400.903101:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3503702a00/0x3640686da09db115 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602400.903119:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853616128:0@lo:101: 00000100:00100000:2.0:1787602400.903168:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602400.903213:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35034b6480 going to sleep for 11 seconds 00000100:00100000:3.0:1787602400.903315:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853616128 00000100:00100000:3.0:1787602400.903321:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853616128 00000100:00100000:3.0:1787602400.903355:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787602400.903370:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:5834:x1874436853616128:12345-0@lo:101: 00010000:00010000:3.0:1787602400.903379:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602400.903390:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3511047e00/0x3640686da09db11c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db115 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602400.903411:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3511047e00/0x3640686da09db11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db115 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602400.903420:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3511047e00/0x3640686da09db11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db115 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602400.903428:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3511047e00, rc 0) 00000100:00100000:3.0:1787602400.903467:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:5834:x1874436853616128:12345-0@lo:101: Request processed in 99us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602400.903473:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787602400.903594:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853616128:0@lo:101: 00010000:00010000:2.0:1787602400.903606:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3503702a00/0x3640686da09db115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db11c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602400.903614:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3503702a00/0x3640686da09db115 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db11c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602400.903656:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853616256:0@lo:501: 00000100:00100000:2.0:1787602400.903682:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602400.903703:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35034b6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787602400.903765:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853616256 00000100:00100000:0.0:1787602400.903770:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853616256 00000100:00100000:0.0:1787602400.903799:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787602400.903807:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:5834:x1874436853616256:12345-0@lo:501: 00000100:00100000:0.0:1787602400.904052:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:5834:x1874436853616256:12345-0@lo:501: Request processed in 245us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602400.904060:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787602400.904201:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853616256:0@lo:501: 00000100:00100000:2.0:1787602400.904243:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853616384:0@lo:503: 00000100:00100000:2.0:1787602400.904280:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602400.904311:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35034b6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787602400.904420:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853616384 00000100:00100000:0.0:1787602400.904425:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853616384 00000100:00100000:0.0:1787602400.904457:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787602400.904465:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:5834:x1874436853616384:12345-0@lo:503: 00000100:00100000:0.0:1787602400.904783:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:5834:x1874436853616384:12345-0@lo:503: Request processed in 317us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602400.904790:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787602400.905007:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853616384:0@lo:503: 00000100:00100000:0.0:1787602400.905627:0:8058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8058:1874436853616512:0@lo:502: 00000100:00100000:0.0:1787602400.905678:0:8058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602400.905724:0:8058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353ca93240 going to sleep for 11 seconds 00000100:00100000:1.0:1787602400.905840:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853616512 00000100:00100000:1.0:1787602400.905856:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853616512 00000100:00100000:1.0:1787602400.905892:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787602400.905900:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:8058:x1874436853616512:12345-0@lo:502: 00000100:00100000:1.0:1787602400.906102:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:8058:x1874436853616512:12345-0@lo:502: Request processed in 201us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602400.906109:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787602400.906329:0:8058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8058:1874436853616512:0@lo:502: 00000020:01000000:0.0:1787602400.906355:0:8058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787602400.906364:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602400.906366:0:8058:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787602400.906371:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787602400.906373:0:8058:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787602400.906389:0:8058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8058:1874436853616640:0@lo:502: 00000100:00100000:0.0:1787602400.906422:0:8058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602400.906449:0:8058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353ca93240 going to sleep for 11 seconds 00000100:00100000:3.0:1787602400.906511:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853616640 00000100:00100000:3.0:1787602400.906516:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853616640 00000100:00100000:3.0:1787602400.906539:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787602400.906546:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:8058:x1874436853616640:12345-0@lo:502: 00000100:00100000:3.0:1787602400.906682:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:8058:x1874436853616640:12345-0@lo:502: Request processed in 136us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602400.906689:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787602400.906770:0:8058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8058:1874436853616640:0@lo:502: 00000020:01000000:0.0:1787602400.906786:0:8058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602400.906790:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602400.906792:0:8058:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787602400.906795:0:8058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1787602400.907024:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787602400.907043:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787602400.907052:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503702a00/0x3640686da09db115 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db11c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602400.907063:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3503702a00/0x3640686da09db115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db11c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602400.907084:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787602400.907086:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3509288800 from 30 10000000:01000000:3.0:1787602400.907089:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787602400.907112:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09db123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602400.907121:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09db123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602400.907130:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09db123 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602400.907153:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853616768:0@lo:101: 00000100:00100000:3.0:1787602400.907183:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602400.907221:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503365a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787602400.907360:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853616768 00000100:00100000:1.0:1787602400.907365:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853616768 00000100:00100000:1.0:1787602400.907388:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787602400.907395:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:5834:x1874436853616768:12345-0@lo:101: 00010000:00010000:1.0:1787602400.907405:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602400.907417:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3528f20a00/0x3640686da09db12a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db123 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602400.907437:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3528f20a00/0x3640686da09db12a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db123 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602400.907447:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3528f20a00/0x3640686da09db12a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db123 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602400.907456:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3528f20a00, rc 0) 00000100:00100000:1.0:1787602400.907495:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853616768:12345-0@lo:101: Request processed in 100us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602400.907502:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787602400.907630:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853616768:0@lo:101: 00010000:00010000:3.0:1787602400.907643:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09db123 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db12a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602400.907651:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09db123 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db12a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602400.907692:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853616896:0@lo:501: 00000100:00100000:3.0:1787602400.907717:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602400.907766:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503365a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787602400.907933:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853616896 00000100:00100000:1.0:1787602400.907938:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853616896 00000100:00100000:1.0:1787602400.908006:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787602400.908014:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853616896:12345-0@lo:501: 00000100:00100000:1.0:1787602400.908264:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853616896:12345-0@lo:501: Request processed in 251us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602400.908271:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787602400.908333:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853616896:0@lo:501: 00000100:00100000:3.0:1787602400.908359:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853617024:0@lo:503: 00000100:00100000:3.0:1787602400.908400:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602400.908794:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503365a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787602400.908906:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853617024 00000100:00100000:2.0:1787602400.908919:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853617024 00000100:00100000:2.0:1787602400.908944:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787602400.908951:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853617024:12345-0@lo:503: 00000100:00100000:2.0:1787602400.909094:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853617024:12345-0@lo:503: Request processed in 143us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602400.909101:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787602400.909488:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853617024:0@lo:503: 00000100:00100000:3.0:1787602400.916599:0:8059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8059:1874436853617152:0@lo:502: 00000100:00100000:3.0:1787602400.916683:0:8059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602400.916785:0:8059:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503365e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787602400.917590:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853617152 00000100:00100000:2.0:1787602400.917600:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853617152 00000100:00100000:2.0:1787602400.917654:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787602400.917664:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:8059:x1874436853617152:12345-0@lo:502: 00000100:00100000:2.0:1787602400.917965:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:8059:x1874436853617152:12345-0@lo:502: Request processed in 301us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602400.917973:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787602400.918625:0:8059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8059:1874436853617152:0@lo:502: 00000100:00100000:3.0:1787602400.918693:0:8059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8059:1874436853617280:0@lo:502: 00000100:00100000:3.0:1787602400.918739:0:8059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602400.918807:0:8059:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503365e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602400.925950:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853617280 00000100:00100000:1.0:1787602400.925965:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853617280 00000100:00100000:1.0:1787602400.926025:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787602400.926036:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:8059:x1874436853617280:12345-0@lo:502: 00000100:00100000:1.0:1787602400.926358:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:8059:x1874436853617280:12345-0@lo:502: Request processed in 323us (7618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602400.926367:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787602400.926616:0:8059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8059:1874436853617280:0@lo:502: 00000040:00080000:0.0:1787602400.926655:0:8059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787602400.927772:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787602400.927802:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787602400.927813:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09db123 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db12a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602400.927825:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09db123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db12a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602400.927835:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787602400.927837:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d3509288800 from 5 10000000:01000000:1.0:1787602400.927840:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787602400.927889:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602400.927897:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602400.927908:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602400.927936:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853617408:0@lo:101: 00000100:00100000:1.0:1787602400.927985:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602400.928025:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32180 going to sleep for 11 seconds 00000100:00100000:0.0:1787602400.928174:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853617408 00000100:00100000:0.0:1787602400.928182:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853617408 00000100:00100000:0.0:1787602400.928237:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787602400.928246:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853617408:12345-0@lo:101: 00010000:00010000:0.0:1787602400.928259:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602400.928274:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3500030a00/0x3640686da09db138 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db131 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602400.928296:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3500030a00/0x3640686da09db138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db131 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602400.928306:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3500030a00/0x3640686da09db138 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db131 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602400.928327:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3500030a00, rc 0) 00000100:00100000:0.0:1787602400.928373:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853617408:12345-0@lo:101: Request processed in 128us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602400.928380:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787602400.928527:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853617408:0@lo:101: 00010000:00010000:2.0:1787602400.928540:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db138 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602400.928549:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db138 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602400.928599:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853617536:0@lo:256: 00000100:00100000:2.0:1787602400.928632:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602400.928656:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350cbb4780 going to sleep for 11 seconds 00000100:00100000:1.0:1787602400.928701:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853617536 00000100:00100000:1.0:1787602400.928705:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853617536 00000100:00100000:1.0:1787602400.928738:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787602400.928771:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853617536:12345-0@lo:256: 20000000:01000000:1.0:1787602400.928793:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787602400.928808:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787602400.928811:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787602400.928964:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853617536:12345-0@lo:256: Request processed in 194us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602400.928972:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787602400.929004:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853617536:0@lo:256: 10000000:01000000:1.0:1787602400.929049:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787602400.929055:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db138 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602400.929062:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db138 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602400.929069:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787602400.929072:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787602400.929074:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787602400.929092:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f21c00/0x3640686da09db13f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602400.929099:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3528f21c00/0x3640686da09db13f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602400.929107:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3528f21c00/0x3640686da09db13f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602400.929119:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853617664:0@lo:101: 00000100:00100000:1.0:1787602400.929156:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602400.929176:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787602400.929192:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853617664 00000100:00100000:1.0:1787602400.929196:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853617664 00000100:00100000:2.0:1787602400.930902:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787602400.930922:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853617664:12345-0@lo:101: 00010000:00010000:2.0:1787602400.930935:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602400.930963:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3503702800/0x3640686da09db146 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db13f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602400.930986:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503702800/0x3640686da09db146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db13f expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602400.930996:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3503702800/0x3640686da09db146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db13f expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602400.931004:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702800, rc 0) 00000100:00100000:2.0:1787602400.931060:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853617664:12345-0@lo:101: Request processed in 149us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602400.931066:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787602400.931410:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853617664:0@lo:101: 00010000:00010000:1.0:1787602400.931428:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3528f21c00/0x3640686da09db13f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db146 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602400.931438:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3528f21c00/0x3640686da09db13f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db146 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602400.931501:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853617792:0@lo:501: 00000100:00100000:1.0:1787602400.931533:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602400.931567:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787602400.931610:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853617792 00000100:00100000:0.0:1787602400.931616:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853617792 00000100:00100000:0.0:1787602400.931651:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787602400.931659:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853617792:12345-0@lo:501: 00000100:00100000:0.0:1787602400.932072:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853617792:12345-0@lo:501: Request processed in 412us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602400.932078:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787602400.932975:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853617792:0@lo:501: 00000100:00100000:1.0:1787602400.933018:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853617920:0@lo:503: 00000100:00100000:1.0:1787602400.933067:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602400.933102:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787602400.934106:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853617920 00000100:00100000:0.0:1787602400.934115:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853617920 00000100:00100000:0.0:1787602400.934169:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787602400.934179:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853617920:12345-0@lo:503: 00000100:00100000:0.0:1787602400.935540:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853617920:12345-0@lo:503: Request processed in 1356us (2466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602400.935550:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787602400.936005:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853617920:0@lo:503: 00000100:00100000:1.0:1787602400.936604:0:8060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8060:1874436853618048:0@lo:502: 00000100:00100000:1.0:1787602400.936664:0:8060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602400.936710:0:8060:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af323c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602400.936954:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853618048 00000100:00100000:3.0:1787602400.936961:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853618048 00000100:00100000:3.0:1787602400.937002:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787602400.937011:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:8060:x1874436853618048:12345-0@lo:502: 00000100:00100000:3.0:1787602400.940501:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:8060:x1874436853618048:12345-0@lo:502: Request processed in 3479us (3825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602400.940517:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787602400.940587:0:8060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8060:1874436853618048:0@lo:502: 00000020:01000000:3.0:1787602400.940626:0:8060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787602400.940634:0:8060:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787602400.940641:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602400.940644:0:8060:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787602400.940649:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787602400.940652:0:8060:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.126@tcp to nid 0x20000c0a8c97e (192.168.201.126@tcp) 00000020:01000000:3.0:1787602400.940675:0:8060:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787602400.940678:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787602400.940699:0:8060:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d353977cd28) 00000020:00000080:3.0:1787602400.940723:0:8060:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787602400.940729:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787602400.940986:0:8060:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787602400.940992:0:8060:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787602400.940999:0:8060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3640686da09db154 00010000:00080000:3.0:1787602400.941031:0:8060:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d3534d8e000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.126@tcp at head 00010000:00010000:3.0:1787602400.941443:0:8060:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1787602400.941779:0:8060:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787602400.941791:0:8060:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00010000:00010000:2.0:1787602400.943889:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787602400.945164:0:8060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787602400.945581:0:8060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787602400.945639:0:8060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787602400.945704:0:8060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787602400.953559:0:8062:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787602400.953566:0:8062:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787602400.954701:0:8060:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787602400.954713:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787602400.954788:0:8060:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787602400.954815:0:8060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3640686da09db15b 00000100:00080000:3.0:1787602400.954828:0:8060:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787602400.954835:0:8060:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d3534d8e000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:3.0:1787602400.956333:0:8060:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d34074c8e00 x1874436853618176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787602400.956365:0:8060:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787602400.956434:0:8060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602400.956440:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602400.956442:0:8060:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787602400.956445:0:8060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602400.956449:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602400.956450:0:8060:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787602400.956462:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787602400.956463:0:8060:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787602400.956491:0:8060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8060:1874436853618304:0@lo:502: 00000100:00100000:3.0:1787602400.956566:0:8060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602400.956598:0:8060:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503365840 going to sleep for 11 seconds 00000100:00100000:0.0:1787602400.956730:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853618176:0@lo:8: 00000100:00100000:0.0:1787602400.956782:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602400.956881:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874436853618432:0@lo:400: 00000100:00100000:0.0:1787602400.956906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602400.956927:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787602400.956933:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853618816:0@lo:400: 00000100:00100000:0.0:1787602400.956952:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602400.956987:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874436853618560:0@lo:400: 00000100:00100000:0.0:1787602400.957009:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602400.957025:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787602400.957029:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853618688:0@lo:400: 00000100:00100000:0.0:1787602400.957048:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602400.957077:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853618432 00000100:00100000:0.0:1787602400.957083:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853618432 00000100:00100000:0.0:1787602400.957116:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853618816 00000100:00100000:0.0:1787602400.957118:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853618816 00000100:00100000:0.0:1787602400.957170:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853618560 00000100:00100000:0.0:1787602400.957174:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853618560 00000100:00100000:0.0:1787602400.957189:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787602400.957198:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874436853618432:12345-0@lo:400: 00000100:00100000:2.0:1787602400.957462:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853618176 00000100:00100000:2.0:1787602400.957466:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853618176 00000100:00100000:2.0:1787602400.957486:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853618688 00000100:00100000:2.0:1787602400.957488:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853618688 00000100:00100000:2.0:1787602400.957508:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602400.957516:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853618688:12345-0@lo:400: 00000100:00100000:2.0:1787602400.957573:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853618688:12345-0@lo:400: Request processed in 58us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602400.957581:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602400.957597:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602400.957601:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3300:x1874436853618176:12345-0@lo:8: 00010000:00080000:2.0:1787602400.957624:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:2.0:1787602400.957651:0:6691:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3640686da09db162 00002000:00100000:2.0:1787602400.957664:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d3405c70800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113951 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787602400.957678:0:6691:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787602400.957682:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787602400.957813:0:6691:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787602400.957966:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787602400.957988:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8d3405c72800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787602400.958030:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1874436853618176:12345-0@lo:8: Request processed in 427us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602400.958036:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787602400.958076:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d34074c8e00 x1874436853618176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787602410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602400.958087:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787602400.958094:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787602400.958101:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787602400.958106:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787602400.958108:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d3534d8e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787602400.958115:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787602400.958119:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853618176:0@lo:8: 00010000:00080000:2.0:1787602400.958163:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3503e4f100 x1874436853618688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602400.958173:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853618688:0@lo:400: 00000100:00100000:2.0:1787602400.958193:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853618304 00000100:00100000:2.0:1787602400.958197:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853618304 00000100:00100000:2.0:1787602400.958967:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787602400.958977:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:8060:x1874436853618304:12345-0@lo:502: 00000100:00100000:0.0:1787602400.960021:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874436853618432:12345-0@lo:400: Request processed in 2820us (3110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602400.960031:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787602400.960055:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787602400.960064:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853618816:12345-0@lo:400: 00000100:00100000:0.0:1787602400.960095:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853618816:12345-0@lo:400: Request processed in 34us (3141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602400.960101:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787602400.960113:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787602400.960119:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874436853618560:12345-0@lo:400: 00000100:00100000:0.0:1787602400.960172:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874436853618560:12345-0@lo:400: Request processed in 53us (3162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602400.960178:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1787602400.960533:0:8062:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787602400.960661:0:8062:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 185906917544ns, next at 0ns, rc = 0 00000100:00080000:0.0:1787602400.960772:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787602400.960779:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787602400.960824:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3503e4fb80 x1874436853618816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602400.960838:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853618816:0@lo:400: 00000100:00100000:2.0:1787602400.960978:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:8060:x1874436853618304:12345-0@lo:502: Request processed in 2002us (4410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602400.960996:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:2.0:1787602400.961040:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3503e4df80 x1874436853618560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602400.961050:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874436853618560:0@lo:400: 00010000:00080000:0.0:1787602400.961966:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3503e4ed80 x1874436853618432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602400.961977:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874436853618432:0@lo:400: 00000100:00100000:3.0:1787602400.962503:0:8060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8060:1874436853618304:0@lo:502: 00000020:01000000:3.0:1787602400.962541:0:8060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602400.962549:0:8060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602400.962552:0:8060:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787602400.962557:0:8060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787602400.962940:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787602400.962961:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787602400.962971:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f21c00/0x3640686da09db13f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db146 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602400.962982:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3528f21c00/0x3640686da09db13f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db146 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602400.962991:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787602400.962994:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d350c9c3370 from 1 10000000:01000000:0.0:1787602400.962997:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787602400.963030:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602400.963038:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602400.963047:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db169 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602400.963068:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853618944:0@lo:101: 00000100:00100000:0.0:1787602400.963124:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602400.963191:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353ca939c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602400.964071:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853618944 00000100:00100000:3.0:1787602400.964082:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853618944 00000100:00100000:3.0:1787602400.964127:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787602400.964149:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853618944:12345-0@lo:101: 00010000:00010000:3.0:1787602400.964164:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602400.964182:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3511047c00/0x3640686da09db170 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db169 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602400.964327:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3511047c00/0x3640686da09db170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db169 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602400.964340:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3511047c00/0x3640686da09db170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db169 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602400.964348:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3511047c00, rc 0) 00000100:00100000:3.0:1787602400.964408:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853618944:12345-0@lo:101: Request processed in 262us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602400.964427:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787602400.964591:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853618944:0@lo:101: 00010000:00010000:0.0:1787602400.964607:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db169 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db170 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602400.964616:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db169 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db170 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602400.964673:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853619072:0@lo:501: 00000100:00100000:0.0:1787602400.964705:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602400.964732:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353ca939c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602400.966784:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853619072 00000100:00100000:3.0:1787602400.966798:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853619072 00000100:00100000:3.0:1787602400.966838:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787602400.966849:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853619072:12345-0@lo:501: 00000100:00100000:3.0:1787602400.967099:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853619072:12345-0@lo:501: Request processed in 252us (2393us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787602400.967107:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787602400.967924:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853619072:0@lo:501: 10000000:01000000:3.0:1787602400.967971:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787602400.967981:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db169 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db170 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602400.967993:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db170 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787602401.014610:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787602401.127974:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853619200:0@lo:13: 00000100:00100000:1.0:1787602401.128050:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602401.128154:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853619200 00000100:00100000:3.0:1787602401.128162:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853619200 00000100:00100000:3.0:1787602401.128241:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787602401.128260:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874436853619200:12345-0@lo:13: 00002000:00000024:3.0:1787602401.128295:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000004:00080000:0.0:1787602401.128503:0:8063:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787602401.128529:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8063:1874436853619328:0@lo:7: 00000100:00100000:0.0:1787602401.128559:0:8063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602401.128583:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32840 going to sleep for 11 seconds 00000100:00080000:0.0:1787602401.128596:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787602401.128608:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853619328 00000100:00100000:0.0:1787602401.128612:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853619328 00000100:00100000:0.0:1787602401.128641:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787602401.128648:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8063:x1874436853619328:12345-0@lo:7: 00000100:00100000:3.0:1787602401.135949:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874436853619200:12345-0@lo:13: Request processed in 7691us (7890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602401.135964:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00002000:00080000:0.0:1787602401.136835:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787602401.136962:0:6691:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787602401.137043:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8063:x1874436853619328:12345-0@lo:7: Request processed in 8393us (8481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602401.137052:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787602401.137098:0:8063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3503e4f480 x1874436853619328/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787602417 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602401.137114:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8063:1874436853619328:0@lo:7: 00000004:00080000:0.0:1787602401.137146:0:8063:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787602401.137186:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8063:1874436853619456:0@lo:5: 00010000:00080000:1.0:1787602401.137351:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3503e4fb80 x1874436853619200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602401.137368:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853619200:0@lo:13: 00000100:00100000:0.0:1787602401.137532:0:8063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602401.137607:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32840 going to sleep for 11 seconds 00000100:00100000:3.0:1787602401.137712:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853619456 00000100:00100000:3.0:1787602401.137719:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853619456 00000100:00100000:3.0:1787602401.137775:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787602401.137793:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8063:x1874436853619456:12345-0@lo:5: 00002000:00080000:3.0:1787602401.137817:0:6689:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787602401.137821:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787602401.138078:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8063:x1874436853619456:12345-0@lo:5: Request processed in 286us (545us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787602401.138085:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787602401.138235:0:8063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3503e4f480 x1874436853619456/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787602417 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602401.138257:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8063:1874436853619456:0@lo:5: 00000004:00080000:1.0:1787602401.138266:0:8063:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787602401.138293:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8063:1874436853619584:0@lo:700: 00000100:00100000:1.0:1787602401.138316:0:8063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602401.138343:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350887d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787602401.138462:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853619584 00000100:00100000:2.0:1787602401.138468:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853619584 00000100:00100000:2.0:1787602401.138505:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602401.138513:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8063:x1874436853619584:12345-0@lo:700: 00000100:00100000:2.0:1787602401.138542:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6697:1874436853619712:0@lo:700: 00000100:00100000:2.0:1787602401.138571:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602401.138593:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d340428b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787602401.138713:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853619712 00000100:00100000:1.0:1787602401.138718:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853619712 00000100:00100000:1.0:1787602401.138779:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602401.138787:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6697:x1874436853619712:12345-0@lo:700: 40000000:02000000:1.0:1787602401.194622:0:5843:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787602401.200228:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6697:x1874436853619712:12345-0@lo:700: Request processed in 61435us (61649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602401.200247:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787602401.200365:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3502f2ea00 x1874436853619712/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787602417 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602401.200378:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6697:1874436853619712:0@lo:700: 40000000:02000000:2.0:1787602401.200390:0:6697:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:2.0:1787602401.284475:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787602401.284493:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1787602401.288315:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8063:x1874436853619584:12345-0@lo:700: Request processed in 149795us (149989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602401.288329:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787602401.288385:0:8063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d350886c000 x1874436853619584/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787602417 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602401.288398:0:8063:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787602401.288415:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8063:1874436853619584:0@lo:700: 00000004:02000040:1.0:1787602401.390558:0:8063:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787602401.393513:0:8063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8063:1874436853619840:0@lo:5: 00000100:00100000:1.0:1787602401.393586:0:8063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602401.393645:0:8063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d340428b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787602401.393674:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853619840 00000100:00100000:1.0:1787602401.393697:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853619840 00000100:00100000:1.0:1787602401.393779:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787602401.393789:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8063:x1874436853619840:12345-0@lo:5: 00002000:00080000:1.0:1787602401.409695:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787602401.409715:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787602401.415525:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8063:x1874436853619840:12345-0@lo:5: Request processed in 21730us (21931us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787602401.415540:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787602401.416987:0:8063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d350886c000 x1874436853619840/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787602417 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602401.417008:0:8063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8063:1874436853619840:0@lo:5: 00000004:00080000:0.0:1787602401.417024:0:8063:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1787602401.965253:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602403.005113:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602403.446207:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602403.446232:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853619968:0@lo:13: 00000100:00100000:0.0:1787602403.446312:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602403.446376:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853619968 00000100:00100000:0.0:1787602403.446384:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853619968 00000100:00100000:0.0:1787602403.446448:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787602403.446458:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853619968:12345-0@lo:13: 00002000:00000024:0.0:1787602403.446490:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602403.446532:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853619968:12345-0@lo:13: Request processed in 75us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602403.446538:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787602403.446803:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787602403.446838:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3503e4ed80 x1874436853619968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602403.446870:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853619968:0@lo:13: 00010000:00010000:2.0:1787602404.013548:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787602404.475103:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1787602404.862834:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602404.864809:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833673344 00000100:00100000:3.0:1787602404.864823:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833673344 00000100:00100000:3.0:1787602404.864862:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 112 00000100:00100000:3.0:1787602404.864870:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1874436833673344:12345-192.168.201.26@tcp:250: 00010000:00080000:3.0:1787602404.864898:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 18c5f36f-e756-4a04-aae1-8fa064a1d6be@192.168.201.26@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:3.0:1787602404.864941:0:5831:0:(genops.c:1385:class_connect()) connect: client 18c5f36f-e756-4a04-aae1-8fa064a1d6be, cookie 0x3640686da09db177 00000100:00080000:3.0:1787602404.865089:0:5831:0:(import.c:65:import_set_state_nolock()) ffff8d3534d8d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787602404.865162:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+5:2350:x1874436833673344:12345-192.168.201.26@tcp:250: Request processed in 291us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602404.865170:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 112 00000100:00100000:2.0:1787602404.874505:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602404.874581:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833673472 00000100:00100000:3.0:1787602404.874590:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833673472 00000100:00100000:3.0:1787602404.874645:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 113 00000100:00100000:3.0:1787602404.874655:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+5:5579:x1874436833673472:12345-192.168.201.26@tcp:101: 00010000:00010000:3.0:1787602404.874672:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602404.874689:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3511047800/0x3640686da09db17e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2252 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602404.874714:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3511047800/0x3640686da09db17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2252 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602404.874725:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3511047800/0x3640686da09db17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2252 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602404.874767:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3511047800, rc 0) 00000100:00100000:3.0:1787602404.874821:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+6:5579:x1874436833673472:12345-192.168.201.26@tcp:101: Request processed in 168us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602404.874827:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 113 00000100:00100000:3.0:1787602404.878607:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602404.878768:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833673600 00000100:00100000:0.0:1787602404.878778:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833673600 00000100:00100000:0.0:1787602404.878825:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 114 00000100:00100000:0.0:1787602404.878835:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+6:5579:x1874436833673600:12345-192.168.201.26@tcp:501: 00000100:00100000:0.0:1787602404.879176:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+6:5579:x1874436833673600:12345-192.168.201.26@tcp:501: Request processed in 341us (577us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787602404.879185:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 114 00000100:00100000:0.0:1787602404.881166:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602404.881270:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833673728 00000100:00100000:3.0:1787602404.881341:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833673728 00000100:00100000:3.0:1787602404.881407:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 115 00000100:00100000:3.0:1787602404.881417:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+6:5579:x1874436833673728:12345-192.168.201.26@tcp:101: 00010000:00010000:3.0:1787602404.881435:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602404.881453:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3511047200/0x3640686da09db185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2259 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602404.881480:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3511047200/0x3640686da09db185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2259 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602404.881491:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3511047200/0x3640686da09db185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2259 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602404.881501:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3511047200, rc 0) 00000100:00100000:3.0:1787602404.881659:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+7:5579:x1874436833673728:12345-192.168.201.26@tcp:101: Request processed in 242us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602404.881667:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 115 00000100:00100000:2.0:1787602404.882972:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602404.883032:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833673856 00000100:00100000:3.0:1787602404.883039:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833673856 00000100:00100000:3.0:1787602404.883086:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 116 00000100:00100000:3.0:1787602404.883096:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+7:5579:x1874436833673856:12345-192.168.201.26@tcp:501: 00000100:00100000:3.0:1787602404.883524:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+8:5579:x1874436833673856:12345-192.168.201.26@tcp:501: Request processed in 428us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602404.883534:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 116 00000100:00100000:3.0:1787602404.885645:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602404.885677:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833673984 00000100:00100000:3.0:1787602404.885687:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833673984 00000100:00100000:3.0:1787602404.885729:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 117 00000100:00100000:3.0:1787602404.885738:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+8:5579:x1874436833673984:12345-192.168.201.26@tcp:503: 00000100:00100000:3.0:1787602404.886022:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+8:5579:x1874436833673984:12345-192.168.201.26@tcp:503: Request processed in 284us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602404.886030:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 117 00000100:00100000:3.0:1787602404.898897:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602404.898970:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833674112 00000100:00100000:2.0:1787602404.898979:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833674112 00000100:00100000:2.0:1787602404.899026:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 118 00000100:00100000:2.0:1787602404.899034:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+8:5598:x1874436833674112:12345-192.168.201.26@tcp:502: 00000100:00100000:2.0:1787602404.899938:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+8:5598:x1874436833674112:12345-192.168.201.26@tcp:502: Request processed in 899us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602404.899991:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 118 00000100:00100000:3.0:1787602404.965833:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602404.966526:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833674240 00000100:00100000:0.0:1787602404.966538:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833674240 00000100:00100000:0.0:1787602404.966592:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 119 00000100:00100000:0.0:1787602404.966603:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+8:5598:x1874436833674240:12345-192.168.201.26@tcp:502: 00000100:00100000:0.0:1787602404.966927:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+8:5598:x1874436833674240:12345-192.168.201.26@tcp:502: Request processed in 323us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602404.966936:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 119 00000100:00100000:2.0:1787602404.971007:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602404.971124:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833674368 00000100:00100000:3.0:1787602404.971144:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833674368 00000100:00100000:3.0:1787602404.971200:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 120 00000100:00100000:3.0:1787602404.971210:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+8:5579:x1874436833674368:12345-192.168.201.26@tcp:101: 00010000:00010000:3.0:1787602404.971226:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602404.971244:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3511046000/0x3640686da09db18c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2283 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602404.971269:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3511046000/0x3640686da09db18c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2283 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602404.971479:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3511046000/0x3640686da09db18c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2283 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602404.971506:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3511046000, rc 0) 00000100:00100000:3.0:1787602404.971567:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:5579:x1874436833674368:12345-192.168.201.26@tcp:101: Request processed in 358us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602404.971574:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 120 00000100:00100000:3.0:1787602404.974955:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602404.975088:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833674496 00000100:00100000:2.0:1787602404.975097:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833674496 00000100:00100000:2.0:1787602404.975158:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 121 00000100:00100000:2.0:1787602404.975168:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:5579:x1874436833674496:12345-192.168.201.26@tcp:256: 20000000:01000000:2.0:1787602404.975193:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787602404.975215:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787602404.975219:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787602404.975223:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787602404.975225:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787602404.976600:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:5579:x1874436833674496:12345-192.168.201.26@tcp:256: Request processed in 1426us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602404.976612:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 121 00000100:00100000:0.0:1787602404.984463:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602404.984691:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833674624 00000100:00100000:3.0:1787602404.984702:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833674624 00000100:00100000:3.0:1787602404.984765:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 122 00000100:00100000:3.0:1787602404.984775:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:5579:x1874436833674624:12345-192.168.201.26@tcp:101: 00010000:00010000:3.0:1787602404.984790:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602404.984805:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d353d432200/0x3640686da09db193 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c228a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602404.984830:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d432200/0x3640686da09db193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c228a expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602404.984842:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d353d432200/0x3640686da09db193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c228a expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602404.984851:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432200, rc 0) 00000100:00100000:3.0:1787602404.984899:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5579:x1874436833674624:12345-192.168.201.26@tcp:101: Request processed in 126us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602404.984907:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 122 00000100:00100000:0.0:1787602404.988582:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602404.988668:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833674752 00000100:00100000:1.0:1787602404.988677:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833674752 00000100:00100000:1.0:1787602404.988734:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 123 00000100:00100000:1.0:1787602404.988763:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5579:x1874436833674752:12345-192.168.201.26@tcp:501: 00000100:00100000:1.0:1787602404.989024:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5579:x1874436833674752:12345-192.168.201.26@tcp:501: Request processed in 281us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602404.989032:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 123 00000100:00100000:3.0:1787602404.993914:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602404.993949:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833674880 00000100:00100000:3.0:1787602404.993958:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833674880 00000100:00100000:3.0:1787602404.994017:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 124 00000100:00100000:3.0:1787602404.994027:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5579:x1874436833674880:12345-192.168.201.26@tcp:503: 00000100:00100000:3.0:1787602404.994561:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5579:x1874436833674880:12345-192.168.201.26@tcp:503: Request processed in 534us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602404.994569:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 124 00000100:00100000:0.0:1787602404.997802:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602404.997896:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833675008 00000100:00100000:3.0:1787602404.997906:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833675008 00000100:00100000:3.0:1787602404.997951:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 125 00000100:00100000:3.0:1787602404.997961:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5602:x1874436833675008:12345-192.168.201.26@tcp:502: 00000100:00100000:3.0:1787602404.998224:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5602:x1874436833675008:12345-192.168.201.26@tcp:502: Request processed in 263us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602404.998233:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 125 00000100:00100000:3.0:1787602405.002308:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602405.002437:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833675136 00000100:00100000:0.0:1787602405.002447:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833675136 00000100:00100000:0.0:1787602405.002495:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 126 00000100:00100000:0.0:1787602405.002505:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5602:x1874436833675136:12345-192.168.201.26@tcp:502: 00000100:00100000:0.0:1787602405.002732:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5602:x1874436833675136:12345-192.168.201.26@tcp:502: Request processed in 227us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602405.002771:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 126 00000100:00100000:0.0:1787602405.016308:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602405.028057:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833675264 00000100:00100000:3.0:1787602405.028102:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833675264 00000100:00100000:3.0:1787602405.028157:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:3.0:1787602405.028168:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1874436833675264:12345-192.168.201.26@tcp:38: 00010000:00080000:3.0:1787602405.028200:0:5838:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:3.0:1787602405.028243:0:5838:0:(genops.c:1385:class_connect()) connect: client e3aefeab-67b4-4a0a-9090-6916c4553638, cookie 0x3640686da09db19a 00000004:00100000:3.0:1787602405.028271:0:5838:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787602405.028277:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1787602405.037701:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787602405.100362:0:5838:0:(import.c:65:import_set_state_nolock()) ffff8d3534d8f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787602405.100454:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2350:x1874436833675264:12345-192.168.201.26@tcp:38: Request processed in 72285us (84153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602405.100465:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:3.0:1787602405.997494:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853620224:0@lo:400: 00000100:00100000:1.0:1787602405.997581:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853620480:0@lo:400: 00000100:00100000:3.0:1787602405.997588:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602405.997656:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853620224 00000100:00100000:0.0:1787602405.997664:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853620224 00000100:00100000:0.0:1787602405.997718:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787602405.997728:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853620224:12345-0@lo:400: 00000100:00100000:2.0:1787602405.999136:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853620096:0@lo:400: 00000100:00100000:1.0:1787602406.001472:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602406.001582:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853620352:0@lo:400: 00000100:00100000:1.0:1787602406.001631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602406.001684:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853620480 00000100:00100000:1.0:1787602406.001690:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853620480 00000100:00100000:1.0:1787602406.001764:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787602406.001790:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853620480:12345-0@lo:400: 00000100:00100000:1.0:1787602406.001840:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853620480:12345-0@lo:400: Request processed in 56us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602406.001848:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787602406.001868:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787602406.001897:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35378f7100 x1874436853620480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602406.001911:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853620480:0@lo:400: 00000100:00100000:1.0:1787602406.001940:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787602406.001947:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787602406.002060:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853620352 00000100:00100000:1.0:1787602406.002064:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853620352 00000100:00100000:1.0:1787602406.002087:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787602406.002094:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787602406.002100:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853620352:12345-0@lo:400: 00000100:00100000:1.0:1787602406.002279:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853620352:12345-0@lo:400: Request processed in 178us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602406.002287:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787602406.002302:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787602406.002319:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35378f5500 x1874436853620352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602406.002329:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853620352:0@lo:400: 00000100:00100000:3.0:1787602406.002685:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853620736:0@lo:400: 00000100:00100000:0.0:1787602406.002699:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853620224:12345-0@lo:400: Request processed in 4971us (5110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602406.002706:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787602406.002720:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787602406.002790:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3503e4f480 x1874436853620224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602406.002800:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853620224:0@lo:400: 00000100:00100000:1.0:1787602406.003386:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853620736 00000100:00100000:1.0:1787602406.003393:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853620736 00000100:00100000:1.0:1787602406.003446:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787602406.003455:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853620736:12345-0@lo:400: 00000100:00100000:1.0:1787602406.003504:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853620736:12345-0@lo:400: Request processed in 51us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602406.003519:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787602406.003641:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787602406.003663:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35378f4700 x1874436853620736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602406.003672:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787602406.003684:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853620736:0@lo:400: 00000100:00100000:2.0:1787602406.007309:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602406.007375:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853620608:0@lo:400: 00000100:00100000:3.0:1787602406.007378:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853620096 00000100:00100000:3.0:1787602406.007388:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853620096 00000100:00100000:2.0:1787602406.007419:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602406.007435:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787602406.007444:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853620096:12345-0@lo:400: 00000100:00100000:3.0:1787602406.007510:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853620096:12345-0@lo:400: Request processed in 66us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602406.007517:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787602406.007610:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853620608 00000100:00100000:1.0:1787602406.007615:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853620608 00000100:00080000:0.0:1787602406.007662:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602406.007666:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787602406.007676:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853620608:12345-0@lo:400: 00000100:00100000:1.0:1787602406.007712:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853620608:12345-0@lo:400: Request processed in 40us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602406.007719:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787602406.010587:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853620096:0@lo:400: 00010000:00080000:2.0:1787602406.010608:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35378f7480 x1874436853620608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602406.010620:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853620608:0@lo:400: 00010000:00010000:0.0:1787602406.060973:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602406.114548:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602406.114596:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602406.116697:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833675392 00000100:00100000:1.0:1787602406.116715:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833675392 00000100:00100000:1.0:1787602406.116824:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833675520 00000100:00100000:1.0:1787602406.116828:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833675520 00000100:00100000:1.0:1787602406.116869:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:1.0:1787602406.116879:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:0:x1874436833675392:12345-192.168.201.26@tcp:41: 00000004:00000024:1.0:1787602406.116923:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787602406.117000:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:0:x1874436833675392:12345-192.168.201.26@tcp:41: Request processed in 122us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602406.117008:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:1.0:1787602406.117025:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:1.0:1787602406.117032:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:5579:x1874436833675520:12345-192.168.201.26@tcp:41: 00000004:00000024:1.0:1787602406.117054:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787602406.117077:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:5579:x1874436833675520:12345-192.168.201.26@tcp:41: Request processed in 46us (2481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602406.117084:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00080000:3.0:1787602406.117496:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602406.126644:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602406.128013:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833675648 00000100:00100000:1.0:1787602406.128028:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833675648 00000100:00100000:1.0:1787602406.128136:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:1.0:1787602406.128148:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:5579:x1874436833675648:12345-192.168.201.26@tcp:40: 00000100:00100000:1.0:1787602406.128251:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:5579:x1874436833675648:12345-192.168.201.26@tcp:40: Request processed in 105us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602406.128258:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:1.0:1787602406.133340:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602406.133385:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602406.133511:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833676032 00000100:00100000:3.0:1787602406.133521:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833676032 00000100:00100000:3.0:1787602406.133584:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:3.0:1787602406.133594:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+6:5579:x1874436833676032:12345-192.168.201.26@tcp:33: 00000100:00100000:1.0:1787602406.136007:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602406.146425:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602406.155468:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833676160 00000100:00100000:1.0:1787602406.155486:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833676160 00000100:00100000:1.0:1787602406.155562:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 128 00000100:00100000:1.0:1787602406.155573:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2353:x1874436833676160:12345-192.168.201.26@tcp:400: 00000100:00100000:1.0:1787602406.155657:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2353:x1874436833676160:12345-192.168.201.26@tcp:400: Request processed in 86us (9246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602406.155666:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 128 00000100:00100000:0.0:1787602406.156116:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833675776 00000100:00100000:0.0:1787602406.156123:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833675776 00000100:00100000:0.0:1787602406.156151:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833675904 00000100:00100000:0.0:1787602406.156154:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833675904 00000100:00100000:0.0:1787602406.156167:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:0.0:1787602406.156173:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1874436833675776:12345-192.168.201.26@tcp:8: 00010000:00080000:0.0:1787602406.156199:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:0.0:1787602406.156240:0:6690:0:(genops.c:1385:class_connect()) connect: client e3aefeab-67b4-4a0a-9090-6916c4553638, cookie 0x3640686da09db1a1 00002000:00100000:0.0:1787602406.156256:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e3aefeab-67b4-4a0a-9090-6916c4553638/ffff8d35351e6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787602406.156500:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787602406.156847:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787602406.156878:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8d35351e4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787602406.156929:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2350:x1874436833675776:12345-192.168.201.26@tcp:8: Request processed in 755us (23544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602406.156948:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:1.0:1787602406.157164:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:1.0:1787602406.157171:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1874436833675904:12345-192.168.201.26@tcp:8: 00010000:00080000:1.0:1787602406.157191:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:1.0:1787602406.157211:0:6690:0:(genops.c:1385:class_connect()) connect: client e3aefeab-67b4-4a0a-9090-6916c4553638, cookie 0x3640686da09db1a8 00002000:00100000:1.0:1787602406.157219:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e3aefeab-67b4-4a0a-9090-6916c4553638/ffff8d34049ca800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787602406.157233:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787602406.157464:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787602406.157481:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8d34049c8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602406.157508:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2350:x1874436833675904:12345-192.168.201.26@tcp:8: Request processed in 335us (21509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602406.157521:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000004:00080000:3.0:1787602406.172837:0:5839:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 39174us 00000004:00200000:3.0:1787602406.202139:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787602406.202903:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+6:5579:x1874436833676032:12345-192.168.201.26@tcp:33: Request processed in 69303us (69565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602406.202915:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:1.0:1787602406.444164:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602406.444810:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833676288 00000100:00100000:0.0:1787602406.444826:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833676288 00000100:00100000:0.0:1787602406.444912:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:0.0:1787602406.444924:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:5620:x1874436833676288:12345-192.168.201.26@tcp:101: 00010000:00010000:0.0:1787602406.444945:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602406.444971:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3500031a00/0x3640686da09db1af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c22b4 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602406.445034:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3500031800/0x3640686da09db1b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602406.445060:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3500031800/0x3640686da09db1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602406.445074:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3500031800/0x3640686da09db1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602406.445296:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787602406.445300:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602406.445378:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3500031800/0x3640686da09db1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602406.445406:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3500031a00/0x3640686da09db1af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22b4 expref: 8 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602406.445423:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3500031800/0x3640686da09db1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22b4 expref: 7 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602406.446478:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502000) 00010000:00010000:0.0:1787602406.446484:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787602406.446489:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3500031800, rc 0) 00000100:00100000:0.0:1787602406.446577:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:5620:x1874436833676288:12345-192.168.201.26@tcp:101: Request processed in 1653us (2428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602406.446586:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:1.0:1787602406.513089:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853620864:0@lo:13: 00000100:00100000:1.0:1787602406.513187:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602406.513564:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853620864 00000100:00100000:0.0:1787602406.513573:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853620864 00000100:00100000:0.0:1787602406.513637:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787602406.513648:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853620864:12345-0@lo:13: 00002000:00000024:0.0:1787602406.513672:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602406.513730:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853620864:12345-0@lo:13: Request processed in 84us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602406.513737:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787602406.514979:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35378f7800 x1874436853620864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602406.515003:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853620864:0@lo:13: 00000001:00100000:1.0:1787602406.635727:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e3aefeab-67b4-4a0a-9090-6916c4553638 00010000:00010000:2.0:1787602407.085310:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602408.109072:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602408.557099:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787602408.557137:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853620992:0@lo:13: 00000100:00100000:2.0:1787602408.557255:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602408.557384:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853620992 00000100:00100000:0.0:1787602408.557396:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853620992 00000100:00080000:3.0:1787602408.557437:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602408.557477:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787602408.557489:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853620992:12345-0@lo:13: 00002000:00000024:0.0:1787602408.557533:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602408.557603:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853620992:12345-0@lo:13: Request processed in 115us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602408.557611:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787602408.557719:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35378f7b80 x1874436853620992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602408.557740:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853620992:0@lo:13: 00000100:00100000:1.0:1787602408.889121:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602408.905367:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833676416 00000100:00100000:2.0:1787602408.905390:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833676416 00000100:00100000:2.0:1787602408.905528:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:2.0:1787602408.905547:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+7:5672:x1874436833676416:12345-192.168.201.26@tcp:41: 00000100:00080000:3.0:1787602408.905554:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1787602408.905630:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787602408.905768:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+7:5672:x1874436833676416:12345-192.168.201.26@tcp:41: Request processed in 227us (16663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602408.905776:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:2.0:1787602408.913925:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602408.914199:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833676544 00000100:00100000:0.0:1787602408.914214:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833676544 00000100:00100000:0.0:1787602408.914364:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:0.0:1787602408.914402:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e3aefeab-67b4-4a0a-9090-6916c4553638+5:5672:x1874436833676544:12345-192.168.201.26@tcp:13: 00002000:00000024:0.0:1787602408.914440:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602408.914533:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e3aefeab-67b4-4a0a-9090-6916c4553638+5:5672:x1874436833676544:12345-192.168.201.26@tcp:13: Request processed in 135us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602408.914542:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00080000:3.0:1787602408.918631:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602408.918834:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602408.919381:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833676672 00000100:00100000:2.0:1787602408.919395:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833676672 00000100:00100000:2.0:1787602408.919485:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:2.0:1787602408.919500:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e3aefeab-67b4-4a0a-9090-6916c4553638+6:5672:x1874436833676672:12345-192.168.201.26@tcp:13: 00002000:00000024:2.0:1787602408.919552:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602408.919646:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e3aefeab-67b4-4a0a-9090-6916c4553638+6:5672:x1874436833676672:12345-192.168.201.26@tcp:13: Request processed in 150us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602408.919654:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00080000:3.0:1787602408.919898:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787602409.133203:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602410.158768:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787602410.184829:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e3aefeab-67b4-4a0a-9090-6916c4553638 00000001:00100000:3.0:1787602410.680765:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e3aefeab-67b4-4a0a-9090-6916c4553638 00000100:00100000:0.0:1787602411.118163:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853621376:0@lo:400: 00000100:00100000:2.0:1787602411.118249:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853621248:0@lo:400: 00000100:00100000:3.0:1787602411.118275:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853621120:0@lo:400: 00000100:00100000:2.0:1787602411.118325:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602411.118329:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602411.118384:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853621760:0@lo:400: 00000100:00100000:1.0:1787602411.118412:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853621504:0@lo:400: 00000100:00100000:2.0:1787602411.118421:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602411.118452:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602411.118479:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853621760 00000100:00100000:2.0:1787602411.118488:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853621760 00000100:00100000:1.0:1787602411.118497:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853621504 00000100:00100000:1.0:1787602411.118502:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853621504 00000100:00100000:2.0:1787602411.118560:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787602411.118561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602411.118576:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853621760:12345-0@lo:400: 00000100:00100000:0.0:1787602411.118602:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853621248 00000100:00100000:0.0:1787602411.118607:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853621248 00000100:00100000:2.0:1787602411.118633:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853621760:12345-0@lo:400: Request processed in 60us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602411.118642:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853621376 00000100:00100000:0.0:1787602411.118646:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853621376 00000100:00100000:2.0:1787602411.118657:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787602411.118717:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35378f6d80 x1874436853621760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602411.118729:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853621760:0@lo:400: 00000100:00100000:2.0:1787602411.118941:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853621120 00000100:00100000:2.0:1787602411.118945:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853621120 00000100:00100000:2.0:1787602411.118980:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787602411.118987:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853621120:12345-0@lo:400: 00000100:00100000:2.0:1787602411.119015:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853621120:12345-0@lo:400: Request processed in 29us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602411.119021:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787602411.119048:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787602411.119055:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853621248:12345-0@lo:400: 00000100:00100000:2.0:1787602411.119084:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853621248:12345-0@lo:400: Request processed in 29us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602411.119090:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787602411.119115:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853621248:0@lo:400: 00000100:00100000:3.0:1787602411.122676:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853621120:0@lo:400: 00000100:00100000:3.0:1787602411.122693:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853621632:0@lo:400: 00000100:00100000:3.0:1787602411.122815:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602411.124517:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853621632 00000100:00100000:3.0:1787602411.124530:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853621632 00000100:00100000:1.0:1787602411.124663:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787602411.124676:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853621504:12345-0@lo:400: 00000100:00100000:1.0:1787602411.124764:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853621504:12345-0@lo:400: Request processed in 91us (6312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602411.124770:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787602411.124812:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35378f5c00 x1874436853621504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602411.124825:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853621504:0@lo:400: 00000100:00080000:2.0:1787602411.129591:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787602411.129603:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787602411.129607:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787602411.129645:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787602411.129665:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853621376:12345-0@lo:400: 00000100:00100000:0.0:1787602411.129777:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853621376:12345-0@lo:400: Request processed in 118us (11219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602411.129784:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787602411.129898:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853621376:0@lo:400: 00000100:00100000:3.0:1787602411.139206:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787602411.139223:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853621632:12345-0@lo:400: 00000100:00100000:3.0:1787602411.139341:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853621632:12345-0@lo:400: Request processed in 123us (16527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602411.139348:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787602411.140119:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853621632:0@lo:400: 00010000:00010000:0.0:1787602411.181192:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602411.220348:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602411.220406:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602411.220460:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602411.220512:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833676800 00000100:00100000:2.0:1787602411.220522:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833676800 00000100:00100000:3.0:1787602411.220554:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833677056 00000100:00100000:3.0:1787602411.220561:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833677056 00000100:00100000:2.0:1787602411.220582:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 130 00000100:00100000:2.0:1787602411.220602:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2354:x1874436833676800:12345-192.168.201.26@tcp:400: 00000100:00100000:3.0:1787602411.220620:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:3.0:1787602411.220630:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833677056:12345-192.168.201.26@tcp:400: 00000100:00100000:2.0:1787602411.220679:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2354:x1874436833676800:12345-192.168.201.26@tcp:400: Request processed in 69us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602411.220687:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 130 00000100:00100000:3.0:1787602411.220706:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833677056:12345-192.168.201.26@tcp:400: Request processed in 77us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602411.220715:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00080000:2.0:1787602411.220721:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602411.222230:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833676928 00000100:00100000:0.0:1787602411.222243:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833676928 00000100:00100000:0.0:1787602411.222331:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:0.0:1787602411.222341:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2353:x1874436833676928:12345-192.168.201.26@tcp:400: 00000100:00100000:0.0:1787602411.222414:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2353:x1874436833676928:12345-192.168.201.26@tcp:400: Request processed in 75us (2077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602411.222421:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00080000:2.0:1787602411.222599:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602411.226793:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602411.227090:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833677184 00000100:00100000:2.0:1787602411.227478:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833677184 00000100:00100000:2.0:1787602411.227624:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:2.0:1787602411.227635:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2353:x1874436833677184:12345-192.168.201.26@tcp:400: 00000100:00100000:2.0:1787602411.227725:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2353:x1874436833677184:12345-192.168.201.26@tcp:400: Request processed in 93us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602411.227733:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00080000:0.0:1787602411.229368:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787602411.638011:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853621888:0@lo:13: 00000100:00100000:2.0:1787602411.638092:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602411.638174:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853621888 00000100:00100000:2.0:1787602411.638182:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853621888 00000100:00100000:2.0:1787602411.638374:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787602411.638386:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853621888:12345-0@lo:13: 00002000:00000024:2.0:1787602411.639109:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602411.639177:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853621888:12345-0@lo:13: Request processed in 791us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602411.639186:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787602411.641445:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3502f2e300 x1874436853621888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602411.641475:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853621888:0@lo:13: 00000001:02000400:0.0:1787602412.101175:0:8299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787602412.205012:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602413.229052:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602413.679242:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853622016:0@lo:13: 00000100:00100000:3.0:1787602413.679323:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602413.679406:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853622016 00000100:00100000:3.0:1787602413.679413:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853622016 00000100:00100000:3.0:1787602413.679472:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787602413.679482:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853622016:12345-0@lo:13: 00002000:00000024:3.0:1787602413.679517:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602413.679562:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853622016:12345-0@lo:13: Request processed in 81us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602413.679569:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787602413.679590:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787602413.679639:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d34074c9c00 x1874436853622016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602413.679657:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853622016:0@lo:13: 00010000:00010000:0.0:1787602414.253052:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602415.280568:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787602416.039609:0:8447:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff31d1c260 20000000:00000080:2.0:1787602416.039626:0:8447:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d3503428400 uarg=0000000000000000 20000000:01000000:2.0:1787602416.039715:0:8447:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787602416.039717:0:8447:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787602416.039720:0:8447:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787602416.039724:0:8447:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787602416.039728:0:8447:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787602416.039767:0:8447:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787602416.039770:0:8447:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787602416.044375:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787602416.044384:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787602416.052639:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787602416.054719:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787602416.054800:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787602416.054839:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1787602416.054858:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787602416.054861:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787602416.058623:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787602416.059494:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787602416.059562:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787602416.059599:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787602416.059614:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787602416.059618:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787602416.066055:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787602416.066904:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787602416.066964:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787602416.067019:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787602416.067034:0:8447:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787602416.067036:0:8447:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787602416.068049:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787602416.068630:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787602416.068681:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787602416.069596:0:8447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1787602416.069622:0:8447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787602416.069641:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d353d432c00/0x3640686da09db1bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.069668:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3511046e00/0x3640686da09db0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db0b3 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.069677:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3500031e00/0x3640686da09db0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db0dd expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.069684:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3500031600/0x3640686da09db10e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db107 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.069691:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3511047e00/0x3640686da09db11c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db115 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.069698:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3528f20a00/0x3640686da09db12a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db123 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.069868:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3503702800/0x3640686da09db146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db13f expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.069886:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3511047c00/0x3640686da09db170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db169 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.069895:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3511047800/0x3640686da09db17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2252 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.069902:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3511047200/0x3640686da09db185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2259 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.069909:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d353d432c00/0x3640686da09db1bd lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.069967:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3511047200/0x3640686da09db185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2259 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.069983:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3511047200/0x3640686da09db185 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2259 expref: 9 pid: 5831 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602416.069998:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853622144:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602416.070262:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3511047800/0x3640686da09db17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2252 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.070273:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3511047800/0x3640686da09db17e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2252 expref: 9 pid: 5829 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602416.070283:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853622272:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602416.070316:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3511047c00/0x3640686da09db170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db169 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.070324:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3511047c00/0x3640686da09db170 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db169 expref: 18 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602416.070331:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853622400:0@lo:104: 00000100:00100000:3.0:1787602416.070370:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602416.070490:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853622400 00000100:00100000:1.0:1787602416.070498:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853622400 00000100:00100000:1.0:1787602416.070547:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787602416.070555:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:8447:x1874436853622400:12345-0@lo:104: 00010000:00010000:1.0:1787602416.070567:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db170 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602416.070615:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602416.070621:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:8447:x1874436853622400:12345-0@lo:104: Request processed in 67us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602416.070627:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787602416.070712:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3503702800/0x3640686da09db146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db13f expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.070721:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3503702800/0x3640686da09db146 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db13f expref: 18 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.070779:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602416.070786:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db170 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.070794:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3500030e00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:0.0:1787602416.070798:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db170 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.070807:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db170 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602416.070814:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db170 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602416.070820:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602416.070852:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db169 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db170 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.070859:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602416.070886:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db169 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db170 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.070894:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db169 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db170 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.070917:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602416.070920:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602416.070921:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602416.070935:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853622656:0@lo:103: 00000100:00100000:0.0:1787602416.070964:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602416.070999:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853622656 00000100:00100000:0.0:1787602416.071003:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853622656 00010000:00010000:0.0:1787602416.071019:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3511047c00/0x3640686da09db170 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db169 expref: 19 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602416.071037:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787602416.071043:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853622656:12345-0@lo:103: 00010000:00010000:0.0:1787602416.071052:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602416.071056:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3511047c00/0x3640686da09db170 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db169 expref: 19 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.071076:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3511047c00/0x3640686da09db170 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db169 expref: 19 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.071091:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602416.071114:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853622656:12345-0@lo:103: Request processed in 71us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602416.071120:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787602416.071148:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853622656:0@lo:103: 00000100:00100000:3.0:1787602416.071371:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853622528:0@lo:104: 00000100:00100000:3.0:1787602416.071523:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787602416.071590:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3528f20a00/0x3640686da09db12a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db123 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.071600:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3528f20a00/0x3640686da09db12a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db123 expref: 18 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602416.071609:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074caa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853622784:0@lo:104: 00010000:00010000:3.0:1787602416.071631:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3511047e00/0x3640686da09db11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db115 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.071638:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3511047e00/0x3640686da09db11c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db115 expref: 18 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602416.071645:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853622912:0@lo:104: 00010000:00010000:3.0:1787602416.071662:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3500031600/0x3640686da09db10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db107 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.071669:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3500031600/0x3640686da09db10e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db107 expref: 18 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602416.071687:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853623040:0@lo:104: 00010000:00010000:3.0:1787602416.071713:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3500031e00/0x3640686da09db0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db0dd expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.071721:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3500031e00/0x3640686da09db0e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db0dd expref: 18 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602416.071761:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853623168:0@lo:104: 00010000:00010000:3.0:1787602416.071790:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3511046e00/0x3640686da09db0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db0b3 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.071799:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3511046e00/0x3640686da09db0ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db0b3 expref: 18 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602416.071807:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853623296:0@lo:104: 00000100:00100000:3.0:1787602416.071820:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3507ce3e40 going to sleep for 11 seconds 00010000:00010000:3.0:1787602416.071832:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3511047c00/0x3640686da09db170 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db169 expref: 18 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602416.071843:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853622400:0@lo:104: 00000100:00100000:1.0:1787602416.072597:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787602416.072620:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602416.072645:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602416.072654:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602416.072662:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602416.072670:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602416.072677:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853622528 00000100:00100000:1.0:1787602416.072691:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853622528 00000100:00100000:1.0:1787602416.072723:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853622784 00000100:00100000:1.0:1787602416.072726:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853622784 00000100:00100000:1.0:1787602416.072763:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853622912 00000100:00100000:1.0:1787602416.072766:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853622912 00000100:00100000:1.0:1787602416.072775:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853623040 00000100:00100000:1.0:1787602416.072777:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853623040 00000100:00100000:1.0:1787602416.072784:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853623168 00000100:00100000:1.0:1787602416.072786:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853623168 00000100:00100000:1.0:1787602416.072793:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853623296 00000100:00100000:1.0:1787602416.072795:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853623296 00000100:00100000:1.0:1787602416.072804:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787602416.072811:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3406202450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+8:8447:x1874436853622528:12345-0@lo:104: 00010000:00010000:1.0:1787602416.072823:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3528f21c00/0x3640686da09db13f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db146 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602416.072882:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602416.072889:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3406202450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+8:8447:x1874436853622528:12345-0@lo:104: Request processed in 78us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602416.072895:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787602416.072928:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787602416.072933:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+7:8447:x1874436853622784:12345-0@lo:104: 00010000:00010000:1.0:1787602416.072940:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09db123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db12a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602416.072967:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787602416.072971:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+7:8447:x1874436853622784:12345-0@lo:104: Request processed in 39us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602416.072977:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787602416.072986:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787602416.072991:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+6:8447:x1874436853622912:12345-0@lo:104: 00010000:00010000:1.0:1787602416.072997:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3503702a00/0x3640686da09db115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db11c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602416.073027:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787602416.073032:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+6:8447:x1874436853622912:12345-0@lo:104: Request processed in 41us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602416.073037:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787602416.073047:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787602416.073052:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+5:8447:x1874436853623040:12345-0@lo:104: 00010000:00010000:1.0:1787602416.073059:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3511046400/0x3640686da09db107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db10e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602416.073938:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853622528:0@lo:104: 00000100:00100000:3.0:1787602416.073948:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074caa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853622784:0@lo:104: 00000100:00100000:3.0:1787602416.073954:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853622912:0@lo:104: 00010000:00010000:1.0:1787602416.074174:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787602416.074181:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+5:8447:x1874436853623040:12345-0@lo:104: Request processed in 1128us (1526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602416.074189:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787602416.074211:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787602416.074220:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+4:8447:x1874436853623168:12345-0@lo:104: 00010000:00010000:1.0:1787602416.074230:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3500030c00/0x3640686da09db0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db0e4 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602416.074259:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787602416.074263:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+4:8447:x1874436853623168:12345-0@lo:104: Request processed in 47us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602416.074268:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787602416.074280:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787602416.074286:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:8447:x1874436853623296:12345-0@lo:104: 00010000:00010000:1.0:1787602416.074293:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3503703e00/0x3640686da09db0b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db0ba expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602416.074332:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787602416.074337:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:8447:x1874436853623296:12345-0@lo:104: Request processed in 52us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602416.074343:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787602416.075243:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787602416.075252:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3528f21c00/0x3640686da09db13f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db146 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.075278:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3528f21c00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:0.0:1787602416.075282:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f21c00/0x3640686da09db13f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db146 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.075291:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3528f21c00/0x3640686da09db13f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db146 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602416.075299:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f21c00/0x3640686da09db13f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db146 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602416.075305:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602416.075336:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3528f21c00/0x3640686da09db13f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db146 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.075342:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602416.075369:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3528f21c00/0x3640686da09db13f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db146 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.075376:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3528f21c00/0x3640686da09db13f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db146 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.075390:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787602416.075394:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09db123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db12a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602416.075475:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853623424:0@lo:103: 00000100:00100000:2.0:1787602416.075517:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602416.075561:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853623424 00000100:00100000:2.0:1787602416.075567:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853623424 00010000:00010000:2.0:1787602416.075589:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3503702800/0x3640686da09db146 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db13f expref: 18 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602416.075612:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787602416.075618:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:3303:x1874436853623424:12345-0@lo:103: 00010000:00010000:2.0:1787602416.075629:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602416.075634:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3503702800/0x3640686da09db146 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db13f expref: 18 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.075644:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3503702800/0x3640686da09db146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db13f expref: 18 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.075670:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3503702800/0x3640686da09db146 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db13f expref: 18 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.075683:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602416.075719:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:3303:x1874436853623424:12345-0@lo:103: Request processed in 100us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602416.075726:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787602416.075785:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853623424:0@lo:103: 00010000:00010000:0.0:1787602416.076084:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3511047000 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:0.0:1787602416.076087:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09db123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db12a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076106:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09db123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db12a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602416.076113:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09db123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db12a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602416.076118:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602416.076136:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09db123 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db12a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076142:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602416.076159:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09db123 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db12a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076166:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3511047000/0x3640686da09db123 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db12a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076177:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787602416.076180:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3503702a00/0x3640686da09db115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db11c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076186:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702a00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:0.0:1787602416.076189:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3503702a00/0x3640686da09db115 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db11c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076204:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3503702a00/0x3640686da09db115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db11c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602416.076211:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3503702a00/0x3640686da09db115 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db11c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602416.076225:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602416.076240:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3503702a00/0x3640686da09db115 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db11c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076246:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602416.076260:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3503702a00/0x3640686da09db115 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db11c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076266:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3503702a00/0x3640686da09db115 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db11c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076275:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787602416.076277:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3511046400/0x3640686da09db107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db10e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076282:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3511046400 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:0.0:1787602416.076285:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3511046400/0x3640686da09db107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db10e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076290:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3511046400/0x3640686da09db107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db10e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602416.076295:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3511046400/0x3640686da09db107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db10e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602416.076301:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602416.076313:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3511046400/0x3640686da09db107 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db10e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076318:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602416.076329:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3511046400/0x3640686da09db107 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db10e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076335:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3511046400/0x3640686da09db107 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db10e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076344:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787602416.076347:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3500030c00/0x3640686da09db0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db0e4 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076352:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3500030c00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:0.0:1787602416.076354:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3500030c00/0x3640686da09db0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db0e4 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076360:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3500030c00/0x3640686da09db0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db0e4 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602416.076365:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3500030c00/0x3640686da09db0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db0e4 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602416.076369:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602416.076380:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3500030c00/0x3640686da09db0dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db0e4 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076386:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602416.076390:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3500030c00/0x3640686da09db0dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db0e4 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.076988:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3500030c00/0x3640686da09db0dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db0e4 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.077004:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602416.077015:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3503703e00/0x3640686da09db0b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db0ba expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.077022:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703e00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:0.0:1787602416.077024:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3503703e00/0x3640686da09db0b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db0ba expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.077032:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3503703e00/0x3640686da09db0b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db0ba expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602416.077039:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3503703e00/0x3640686da09db0b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db0ba expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602416.077044:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787602416.077170:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853623936:0@lo:103: 00000100:00100000:2.0:1787602416.077240:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602416.077280:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602416.077286:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853623552:0@lo:103: 00000100:00100000:2.0:1787602416.077308:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602416.077334:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853623936 00000100:00100000:2.0:1787602416.077340:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853623936 00010000:00010000:2.0:1787602416.077363:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3500031e00/0x3640686da09db0e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db0dd expref: 17 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602416.077378:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853623552 00000100:00100000:2.0:1787602416.077381:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853623552 00010000:00010000:2.0:1787602416.077391:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3528f20a00/0x3640686da09db12a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db123 expref: 18 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602416.077416:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787602416.077424:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c889f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:3303:x1874436853623936:12345-0@lo:103: 00010000:00010000:2.0:1787602416.077435:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602416.077439:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3500031e00/0x3640686da09db0e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db0dd expref: 18 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.077460:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3500031e00/0x3640686da09db0e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db0dd expref: 18 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.077476:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602416.077506:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c889f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:3303:x1874436853623936:12345-0@lo:103: Request processed in 83us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602416.077512:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787602416.077528:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787602416.077534:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:3303:x1874436853623552:12345-0@lo:103: 00010000:00010000:2.0:1787602416.077542:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602416.077546:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3528f20a00/0x3640686da09db12a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db123 expref: 17 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.077554:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3528f20a00/0x3640686da09db12a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db123 expref: 17 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.077564:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3528f20a00/0x3640686da09db12a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db123 expref: 17 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.077572:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602416.077592:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:3303:x1874436853623552:12345-0@lo:103: Request processed in 59us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602416.077598:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787602416.077625:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853623552:0@lo:103: 00000100:00100000:2.0:1787602416.077633:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853623936:0@lo:103: 00010000:00010000:2.0:1787602416.077903:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602416.077912:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602416.078074:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853623680:0@lo:103: 00000100:00100000:1.0:1787602416.078107:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602416.078145:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602416.078151:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853623808:0@lo:103: 00000100:00100000:1.0:1787602416.078172:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602416.078305:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3503703e00/0x3640686da09db0b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db0ba expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.078314:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787602416.078423:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853624064:0@lo:103: 00010000:00010000:0.0:1787602416.078434:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3503703e00/0x3640686da09db0b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db0ba expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602416.078442:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3503703e00/0x3640686da09db0b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db0ba expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602416.078450:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602416.078457:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602416.078459:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602416.078461:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602416.078593:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853623680 00000100:00100000:2.0:1787602416.078600:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853623680 00010000:00010000:2.0:1787602416.078623:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3511047e00/0x3640686da09db11c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db115 expref: 16 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602416.078637:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853623808 00000100:00100000:2.0:1787602416.078640:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853623808 00010000:00010000:2.0:1787602416.078649:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3500031600/0x3640686da09db10e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db107 expref: 17 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602416.078657:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853624064 00000100:00100000:2.0:1787602416.078660:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853624064 00010000:00010000:2.0:1787602416.078670:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3511046e00/0x3640686da09db0ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db0b3 expref: 18 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602416.078681:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787602416.078692:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:3301:x1874436853623680:12345-0@lo:103: 00010000:00010000:2.0:1787602416.078712:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602416.078717:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3511047e00/0x3640686da09db11c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db115 expref: 18 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.078726:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3511047e00/0x3640686da09db11c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db115 expref: 18 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.078739:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3511047e00/0x3640686da09db11c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db115 expref: 18 pid: 5832 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.078767:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602416.078803:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:3301:x1874436853623680:12345-0@lo:103: Request processed in 111us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602416.078810:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787602416.078832:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787602416.078838:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:3301:x1874436853623808:12345-0@lo:103: 00010000:00010000:2.0:1787602416.078845:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602416.078850:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3500031600/0x3640686da09db10e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db107 expref: 16 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.078858:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3500031600/0x3640686da09db10e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db107 expref: 16 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.078868:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602416.078897:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:3301:x1874436853623808:12345-0@lo:103: Request processed in 60us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602416.078903:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787602416.078913:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787602416.078918:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3509d55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:3304:x1874436853624064:12345-0@lo:103: 00010000:00010000:2.0:1787602416.078925:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602416.078928:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3511046e00/0x3640686da09db0ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db0b3 expref: 15 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.078937:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3511046e00/0x3640686da09db0ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db0b3 expref: 15 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.078946:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602416.078969:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3509d55450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:3304:x1874436853624064:12345-0@lo:103: Request processed in 50us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602416.078974:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787602416.079023:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853624064:0@lo:103: 00000100:00100000:1.0:1787602416.079345:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853623808:0@lo:103: 00000100:00100000:1.0:1787602416.079353:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853623680:0@lo:103: 00010000:00010000:3.0:1787602416.079729:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3500031600/0x3640686da09db10e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db107 expref: 14 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602416.079762:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853623040:0@lo:104: 00010000:00010000:3.0:1787602416.079774:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3500031e00/0x3640686da09db0e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db0dd expref: 13 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602416.079782:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853623168:0@lo:104: 00010000:00010000:3.0:1787602416.079791:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3511046e00/0x3640686da09db0ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db0b3 expref: 12 pid: 5831 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602416.079813:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853623296:0@lo:104: 00000100:00100000:1.0:1787602416.080090:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602416.080158:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602416.080217:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833677312 00000100:00100000:2.0:1787602416.080228:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833677312 00010000:00010000:2.0:1787602416.080249:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3511047200/0x3640686da09db185 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2259 expref: 10 pid: 5831 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602416.080264:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833677440 00000100:00100000:2.0:1787602416.080266:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833677440 00010000:00010000:2.0:1787602416.080274:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3511047800/0x3640686da09db17e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2252 expref: 11 pid: 5829 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602416.080285:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:2.0:1787602416.080291:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:2352:x1874436833677312:12345-192.168.201.26@tcp:103: 00010000:00010000:2.0:1787602416.080300:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602416.080305:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3511047200/0x3640686da09db185 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2259 expref: 11 pid: 5831 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.080315:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3511047200/0x3640686da09db185 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2259 expref: 11 pid: 5831 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.080329:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602416.080372:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:2352:x1874436833677312:12345-192.168.201.26@tcp:103: Request processed in 80us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602416.080379:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:2.0:1787602416.080391:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:2.0:1787602416.080406:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2352:x1874436833677440:12345-192.168.201.26@tcp:103: 00010000:00010000:2.0:1787602416.080413:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602416.080417:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3511047800/0x3640686da09db17e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2252 expref: 10 pid: 5829 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.080426:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3511047800/0x3640686da09db17e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2252 expref: 10 pid: 5829 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.080443:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d353d432c00/0x3640686da09db1bd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.080452:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d432c00/0x3640686da09db1bd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.080465:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d353d432c00/0x3640686da09db1bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.080473:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d353d432c00/0x3640686da09db1bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.080480:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d353d432c00/0x3640686da09db1bd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.080487:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d353d432c00/0x3640686da09db1bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.080493:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432c00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602416.080497:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d353d432c00/0x3640686da09db1bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.080505:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d353d432c00/0x3640686da09db1bd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.080513:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d353d432c00/0x3640686da09db1bd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602416.080522:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602416.080538:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2352:x1874436833677440:12345-192.168.201.26@tcp:103: Request processed in 141us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602416.080551:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00010000:00010000:3.0:1787602416.082371:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3511047200/0x3640686da09db185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2259 expref: 9 pid: 5831 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602416.082394:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853622144:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602416.082421:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3511047800/0x3640686da09db17e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2252 expref: 8 pid: 5829 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602416.082430:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8447:1874436853622272:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602416.082479:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d353d432c00/0x3640686da09db1bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.082489:0:8447:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d353d432c00/0x3640686da09db1bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.082495:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d353d432c00/0x3640686da09db1bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602416.082501:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d353d432c00/0x3640686da09db1bd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602416.237593:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853624576:0@lo:400: 00000100:00100000:1.0:1787602416.237700:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602416.237778:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787602416.237785:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853624448:0@lo:400: 00000100:00100000:0.0:1787602416.237809:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853624192:0@lo:400: 00000100:00100000:1.0:1787602416.237813:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602416.237838:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602416.237851:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853624448 00000100:00100000:0.0:1787602416.237855:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853624704:0@lo:400: 00000100:00100000:1.0:1787602416.237858:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853624448 00000100:00100000:0.0:1787602416.237899:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602416.237924:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853624704 00000100:00100000:1.0:1787602416.237928:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853624704 00000100:00100000:0.0:1787602416.237930:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787602416.237936:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874436853624320:0@lo:400: 00000100:00100000:1.0:1787602416.237947:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787602416.237965:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853624448:12345-0@lo:400: 00000100:00100000:1.0:1787602416.238020:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853624448:12345-0@lo:400: Request processed in 58us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602416.238027:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787602416.238036:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602416.238043:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787602416.238050:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853624704:12345-0@lo:400: 00000100:00100000:0.0:1787602416.238063:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853624576 00000100:00100000:0.0:1787602416.238067:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853624576 00000100:00100000:0.0:1787602416.238094:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853624192 00000100:00100000:0.0:1787602416.238097:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853624192 00000100:00100000:0.0:1787602416.238108:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853624320 00000100:00100000:0.0:1787602416.238110:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853624320 00000100:00100000:0.0:1787602416.238123:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787602416.238144:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853624576:12345-0@lo:400: 00000100:00100000:0.0:1787602416.238809:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853624576:12345-0@lo:400: Request processed in 678us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602416.238817:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787602416.238834:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787602416.238840:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853624192:12345-0@lo:400: 00000100:00100000:0.0:1787602416.238889:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853624192:12345-0@lo:400: Request processed in 49us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602416.238894:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787602416.238917:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787602416.238924:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874436853624320:12345-0@lo:400: 00000100:00100000:0.0:1787602416.239022:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874436853624320:12345-0@lo:400: Request processed in 98us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602416.239028:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787602416.239165:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874436853624320:0@lo:400: 00000100:00100000:0.0:1787602416.239783:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853624192:0@lo:400: 00000100:00080000:3.0:1787602416.239814:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787602416.239819:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787602416.239822:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787602416.242258:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35351c5500 x1874436853624448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602416.242277:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853624448:0@lo:400: 00000100:00100000:3.0:1787602416.242305:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853624576:0@lo:400: 00000100:00100000:1.0:1787602416.243569:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853624704:12345-0@lo:400: Request processed in 5509us (5660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602416.243582:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787602416.243666:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35351c7480 x1874436853624704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602416.243796:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853624704:0@lo:400: 00010000:00010000:2.0:1787602416.301477:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602416.340001:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602416.340049:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602416.340092:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602416.340128:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602416.340165:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833677952 00000100:00100000:3.0:1787602416.340175:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833677952 00000100:00100000:3.0:1787602416.340252:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833677824 00000100:00100000:3.0:1787602416.340256:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833677824 00000100:00100000:3.0:1787602416.340280:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:3.0:1787602416.340290:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2353:x1874436833677952:12345-192.168.201.26@tcp:400: 00000100:00100000:3.0:1787602416.340361:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2353:x1874436833677952:12345-192.168.201.26@tcp:400: Request processed in 72us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602416.340369:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:3.0:1787602416.340385:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:3.0:1787602416.340522:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2353:x1874436833677824:12345-192.168.201.26@tcp:400: 00000100:00100000:3.0:1787602416.340550:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2353:x1874436833677824:12345-192.168.201.26@tcp:400: Request processed in 159us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602416.340557:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00080000:3.0:1787602416.340575:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787602416.340579:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787602416.340785:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833677568 00000100:00100000:1.0:1787602416.340789:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833677568 00000100:00100000:1.0:1787602416.340818:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 131 00000100:00100000:1.0:1787602416.340825:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+8:2353:x1874436833677568:12345-192.168.201.26@tcp:400: 00000100:00100000:1.0:1787602416.340859:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+8:2353:x1874436833677568:12345-192.168.201.26@tcp:400: Request processed in 35us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602416.340879:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 131 00000100:00100000:0.0:1787602416.341567:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833677696 00000100:00100000:0.0:1787602416.341574:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833677696 00000100:00100000:0.0:1787602416.341630:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 29 00000100:00100000:0.0:1787602416.341639:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2353:x1874436833677696:12345-192.168.201.26@tcp:400: 00000100:00100000:0.0:1787602416.341694:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2353:x1874436833677696:12345-192.168.201.26@tcp:400: Request processed in 57us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602416.341701:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 29 00000100:00080000:3.0:1787602416.342590:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602416.750764:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602416.750821:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c889f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853624832:0@lo:13: 00000100:00100000:3.0:1787602416.750917:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602416.751114:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853624832 00000100:00100000:2.0:1787602416.751123:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853624832 00000100:00100000:2.0:1787602416.751188:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787602416.751200:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853624832:12345-0@lo:13: 00002000:00000024:2.0:1787602416.751263:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602416.751318:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853624832:12345-0@lo:13: Request processed in 121us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602416.751326:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787602416.751820:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d350c889f80 x1874436853624832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602416.751858:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c889f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853624832:0@lo:13: 10000000:01000000:3.0:1787602417.324955:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787602417.324963:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d35271fb800 from 39 10000000:01000000:3.0:1787602417.324969:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787602417.325019:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602417.325030:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602417.325041:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602417.325064:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853624960:0@lo:101: 00010000:00010000:2.0:1787602417.325109:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602417.325141:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602417.325212:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3507ce3000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602417.325356:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853624960 00000100:00100000:1.0:1787602417.325366:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853624960 00000100:00100000:1.0:1787602417.325432:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787602417.325443:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+12:5834:x1874436853624960:12345-0@lo:101: 00010000:00010000:1.0:1787602417.325457:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602417.325474:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3528f21200/0x3640686da09db1cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db1c4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602417.325496:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3528f21200/0x3640686da09db1cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db1c4 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602417.325531:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3528f21200/0x3640686da09db1cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db1c4 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602417.325540:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3528f21200, rc 0) 00000100:00100000:1.0:1787602417.325593:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:5834:x1874436853624960:12345-0@lo:101: Request processed in 151us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602417.325600:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787602417.325688:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853624960:0@lo:101: 00010000:00010000:3.0:1787602417.325702:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db1cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602417.325710:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db1cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602417.325792:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853625088:0@lo:501: 00000100:00100000:3.0:1787602417.325820:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602417.325861:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3507ce3000 going to sleep for 11 seconds 00000100:00100000:0.0:1787602417.325910:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853625088 00000100:00100000:0.0:1787602417.325916:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853625088 00000100:00100000:0.0:1787602417.325958:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787602417.325966:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:5834:x1874436853625088:12345-0@lo:501: 00000100:00100000:0.0:1787602417.326254:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:5834:x1874436853625088:12345-0@lo:501: Request processed in 288us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602417.326262:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787602417.326306:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853625088:0@lo:501: 00000100:00100000:3.0:1787602417.326343:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853625216:0@lo:503: 00000100:00100000:3.0:1787602417.326378:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602417.326399:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3507ce3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787602417.326452:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853625216 00000100:00100000:2.0:1787602417.326457:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853625216 00000100:00100000:2.0:1787602417.326492:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787602417.326500:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:5834:x1874436853625216:12345-0@lo:503: 00000100:00100000:2.0:1787602417.326662:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:5834:x1874436853625216:12345-0@lo:503: Request processed in 163us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602417.326669:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787602417.326770:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853625216:0@lo:503: 00000100:00100000:3.0:1787602417.327119:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8464:1874436853625344:0@lo:502: 00000100:00100000:3.0:1787602417.327158:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602417.327193:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3507ce3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602417.327290:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853625344 00000100:00100000:2.0:1787602417.327296:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853625344 00000100:00100000:2.0:1787602417.327318:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787602417.327325:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:8464:x1874436853625344:12345-0@lo:502: 00000100:00100000:2.0:1787602417.327542:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:8464:x1874436853625344:12345-0@lo:502: Request processed in 216us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602417.327555:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787602417.327712:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8464:1874436853625344:0@lo:502: 00000100:00100000:3.0:1787602417.327772:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8464:1874436853625472:0@lo:502: 00000100:00100000:3.0:1787602417.327804:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602417.327821:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3507ce3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602417.328020:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853625472 00000100:00100000:2.0:1787602417.328025:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853625472 00000100:00100000:2.0:1787602417.328045:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787602417.328052:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:8464:x1874436853625472:12345-0@lo:502: 00000100:00100000:2.0:1787602417.328205:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:8464:x1874436853625472:12345-0@lo:502: Request processed in 153us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602417.328211:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787602417.328374:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8464:1874436853625472:0@lo:502: 00000040:00080000:3.0:1787602417.328393:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787602417.329003:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787602417.329023:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787602417.329033:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db1cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.329044:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db1cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602417.329053:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787602417.329056:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787602417.329058:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787602417.329097:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.329104:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.329112:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602417.329127:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c888380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853625600:0@lo:101: 00000100:00100000:2.0:1787602417.329169:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602417.329204:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503f2c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787602417.329310:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853625600 00000100:00100000:0.0:1787602417.329316:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853625600 00000100:00100000:0.0:1787602417.329351:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787602417.329359:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+13:5834:x1874436853625600:12345-0@lo:101: 00010000:00010000:0.0:1787602417.329369:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602417.329381:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3500030c00/0x3640686da09db1d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db1d2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602417.329403:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3500030c00/0x3640686da09db1d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db1d2 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602417.329412:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3500030c00/0x3640686da09db1d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db1d2 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602417.329431:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3500030c00, rc 0) 00000100:00100000:0.0:1787602417.329475:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:5834:x1874436853625600:12345-0@lo:101: Request processed in 116us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602417.329481:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787602417.330457:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c888380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853625600:0@lo:101: 00010000:00010000:2.0:1787602417.330479:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db1d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.330490:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db1d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602417.330555:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c888380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853625728:0@lo:501: 00000100:00100000:2.0:1787602417.330662:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602417.330699:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503f2c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787602417.330769:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853625728 00000100:00100000:3.0:1787602417.330776:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853625728 00000100:00100000:3.0:1787602417.330817:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787602417.330825:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:5834:x1874436853625728:12345-0@lo:501: 00000100:00100000:3.0:1787602417.331118:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:5834:x1874436853625728:12345-0@lo:501: Request processed in 293us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602417.331125:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787602417.331162:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c888380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853625728:0@lo:501: 00000100:00100000:3.0:1787602417.331191:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853625856:0@lo:503: 00000100:00100000:3.0:1787602417.331444:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602417.331473:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3507ce33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602417.331498:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853625856 00000100:00100000:3.0:1787602417.331502:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853625856 00000100:00100000:3.0:1787602417.331531:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787602417.331538:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:5834:x1874436853625856:12345-0@lo:503: 00000100:00100000:3.0:1787602417.331700:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:5834:x1874436853625856:12345-0@lo:503: Request processed in 162us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602417.331707:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787602417.331780:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853625856:0@lo:503: 00000100:00100000:3.0:1787602417.332001:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8465:1874436853625984:0@lo:502: 00000100:00100000:3.0:1787602417.332034:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602417.332052:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853625984 00000100:00100000:3.0:1787602417.332056:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853625984 00000100:00100000:3.0:1787602417.332076:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787602417.332084:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:8465:x1874436853625984:12345-0@lo:502: 00000100:00100000:2.0:1787602417.333430:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3507ce3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602417.334719:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:8465:x1874436853625984:12345-0@lo:502: Request processed in 2628us (2676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602417.334733:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787602417.335195:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8465:1874436853625984:0@lo:502: 00000020:01000000:1.0:1787602417.335284:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787602417.335296:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602417.335299:0:8465:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787602417.335306:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787602417.335348:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8465:1874436853626112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602417.335400:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602417.335441:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602417.335917:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853626112 00000100:00100000:3.0:1787602417.335925:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853626112 00000100:00100000:3.0:1787602417.335979:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787602417.335989:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:8465:x1874436853626112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602417.336229:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:8465:x1874436853626112:12345-0@lo:502:llog_process_th.0 Request processed in 241us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602417.336238:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787602417.338196:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8465:1874436853626112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787602417.338244:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602417.338255:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602417.338257:0:8465:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787602417.338262:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787602417.338541:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787602417.338564:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787602417.338585:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db1d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602417.338596:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db1d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602417.338605:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787602417.338607:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d353d79c800 from 39 10000000:01000000:3.0:1787602417.338610:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787602417.338646:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602417.338654:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602417.338663:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602417.338682:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853626240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787602417.338735:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602417.338809:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3507ce3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787602417.338909:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853626240 00000100:00100000:2.0:1787602417.338916:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853626240 00000100:00100000:2.0:1787602417.338955:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787602417.338964:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:5834:x1874436853626240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602417.338975:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602417.338988:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3503702600/0x3640686da09db1e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db1e0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.339010:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503702600/0x3640686da09db1e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db1e0 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.339020:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3503702600/0x3640686da09db1e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db1e0 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.339029:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702600, rc 0) 00000100:00100000:2.0:1787602417.339069:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:5834:x1874436853626240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602417.339076:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787602417.339286:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853626240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602417.339299:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db1e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602417.339308:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db1e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602417.339353:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853626368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602417.339386:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602417.339408:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3507ce3900 going to sleep for 11 seconds 00000100:00100000:0.0:1787602417.339539:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853626368 00000100:00100000:0.0:1787602417.339544:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853626368 00000100:00100000:0.0:1787602417.339576:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787602417.339583:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:5834:x1874436853626368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602417.339888:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:5834:x1874436853626368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602417.339895:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787602417.340231:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853626368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.340266:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853626496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.340307:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602417.340333:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602417.340422:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853626496 00000100:00100000:3.0:1787602417.340427:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853626496 00000100:00100000:3.0:1787602417.340451:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787602417.340458:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:5834:x1874436853626496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602417.340633:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:5834:x1874436853626496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602417.340640:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787602417.340712:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853626496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602417.341148:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c88aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8466:1874436853626624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602417.341187:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602417.341222:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35351f1540 going to sleep for 11 seconds 00000100:00100000:3.0:1787602417.341324:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853626624 00000100:00100000:3.0:1787602417.341329:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853626624 00000100:00100000:3.0:1787602417.341360:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787602417.341368:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:8466:x1874436853626624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602417.341564:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:8466:x1874436853626624:12345-0@lo:502:llog_process_th.0 Request processed in 197us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602417.341570:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787602417.341642:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c88aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8466:1874436853626624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602417.341686:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8466:1874436853626752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602417.341717:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602417.341762:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602417.341821:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853626752 00000100:00100000:0.0:1787602417.341827:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853626752 00000100:00100000:0.0:1787602417.341846:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787602417.341864:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:8466:x1874436853626752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602417.342006:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:8466:x1874436853626752:12345-0@lo:502:llog_process_th.0 Request processed in 143us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602417.342012:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787602417.342358:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8466:1874436853626752:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787602417.342382:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787602417.342959:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787602417.342979:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787602417.342989:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db1e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602417.343002:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db1e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602417.343027:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787602417.343031:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787602417.343034:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787602417.343065:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602417.343073:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602417.343082:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602417.343119:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853626880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602417.343159:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602417.343195:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353d594c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787602417.343247:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853626880 00000100:00100000:3.0:1787602417.343252:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853626880 00000100:00100000:3.0:1787602417.343295:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787602417.343302:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:5834:x1874436853626880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602417.343313:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602417.343325:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d353d432c00/0x3640686da09db1f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db1ee expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602417.343347:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d432c00/0x3640686da09db1f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db1ee expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602417.343356:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d353d432c00/0x3640686da09db1f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db1ee expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602417.343372:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432c00, rc 0) 00000100:00100000:3.0:1787602417.343415:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853626880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602417.343421:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787602417.343492:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853626880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602417.343505:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db1f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602417.343515:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db1f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602417.343557:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853627008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602417.343582:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602417.343602:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353d594c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787602417.343641:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853627008 00000100:00100000:3.0:1787602417.343645:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853627008 00000100:00100000:3.0:1787602417.343670:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787602417.343676:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853627008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602417.343928:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853627008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602417.343935:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787602417.344017:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853627008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.344046:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853627136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.344080:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602417.344100:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602417.344156:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853627136 00000100:00100000:3.0:1787602417.344160:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853627136 00000100:00100000:3.0:1787602417.344176:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787602417.344181:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853627136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602417.344312:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853627136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602417.344318:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787602417.344378:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853627136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602417.344801:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8467:1874436853627264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602417.344835:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602417.344868:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353d594e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602417.344999:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853627264 00000100:00100000:3.0:1787602417.345003:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853627264 00000100:00100000:3.0:1787602417.345031:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787602417.345038:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:8467:x1874436853627264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602417.345174:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:8467:x1874436853627264:12345-0@lo:502:llog_process_th.0 Request processed in 134us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602417.345180:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787602417.345554:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8467:1874436853627264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787602417.345579:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787602417.345588:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602417.345591:0:8467:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787602417.345595:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787602417.345617:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8467:1874436853627392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602417.345653:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602417.345686:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353d594e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602417.345830:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853627392 00000100:00100000:3.0:1787602417.345835:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853627392 00000100:00100000:3.0:1787602417.345870:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787602417.345877:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:8467:x1874436853627392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602417.346024:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:8467:x1874436853627392:12345-0@lo:502:llog_process_th.0 Request processed in 147us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602417.346031:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787602417.346115:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8467:1874436853627392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787602417.346135:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602417.346140:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602417.346142:0:8467:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787602417.346146:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787602417.346347:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787602417.346364:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787602417.346373:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db1f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.346384:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db1f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602417.346395:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787602417.346397:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3509288800 from 39 10000000:01000000:2.0:1787602417.346400:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787602417.346426:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.346434:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.346443:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602417.346458:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c889500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853627520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787602417.346488:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602417.346520:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35351f1540 going to sleep for 11 seconds 00000100:00100000:1.0:1787602417.346577:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853627520 00000100:00100000:1.0:1787602417.346583:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853627520 00000100:00100000:1.0:1787602417.346615:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787602417.346623:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853627520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602417.346631:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602417.346645:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3528f20600/0x3640686da09db203 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db1fc expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602417.346678:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3528f20600/0x3640686da09db203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db1fc expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602417.346688:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3528f20600/0x3640686da09db203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db1fc expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602417.346696:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3528f20600, rc 0) 00000100:00100000:1.0:1787602417.346730:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853627520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602417.346736:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787602417.346793:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c889500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853627520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602417.346804:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db203 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602417.346813:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db203 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602417.346868:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853627648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.346892:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602417.346906:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787602417.346917:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853627648 00000100:00100000:1.0:1787602417.346920:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853627648 00000100:00100000:1.0:1787602417.346937:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787602417.346942:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853627648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.347182:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853627648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602417.347198:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787602417.347228:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853627648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.347256:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853627776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.347288:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602417.347302:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787602417.347313:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853627776 00000100:00100000:1.0:1787602417.347316:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853627776 00000100:00100000:1.0:1787602417.347333:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787602417.347340:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853627776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.347471:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853627776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602417.347478:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787602417.347511:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853627776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.347673:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8468:1874436853627904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602417.347703:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602417.347722:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853627904 00000100:00100000:1.0:1787602417.347725:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853627904 00000100:00100000:1.0:1787602417.347763:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787602417.347771:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:8468:x1874436853627904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602417.347927:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:8468:x1874436853627904:12345-0@lo:502:llog_process_th.0 Request processed in 157us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602417.347934:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787602417.347963:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948180 going to sleep for 11 seconds 00000100:00100000:1.0:1787602417.347974:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8468:1874436853627904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602417.348018:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8468:1874436853628032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602417.348047:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602417.348065:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853628032 00000100:00100000:1.0:1787602417.348068:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853628032 00000100:00100000:1.0:1787602417.348083:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787602417.348089:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:8468:x1874436853628032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602417.348202:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:8468:x1874436853628032:12345-0@lo:502:llog_process_th.0 Request processed in 112us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602417.348209:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787602417.348235:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948180 going to sleep for 11 seconds 00000100:00100000:1.0:1787602417.348246:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8468:1874436853628032:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787602417.348263:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787602417.348302:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787602417.348313:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787602417.348320:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db203 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602417.348329:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db203 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602417.348338:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787602417.348341:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787602417.348344:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787602417.348363:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602417.348371:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602417.348386:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602417.348399:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853628160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.348424:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602417.348437:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948180 going to sleep for 11 seconds 00000100:00100000:1.0:1787602417.348449:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853628160 00000100:00100000:1.0:1787602417.348452:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853628160 00000100:00100000:1.0:1787602417.348469:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787602417.348474:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853628160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602417.348481:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602417.348492:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3528f20a00/0x3640686da09db211 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db20a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602417.348508:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3528f20a00/0x3640686da09db211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db20a expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602417.348517:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3528f20a00/0x3640686da09db211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db20a expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602417.348524:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3528f20a00, rc 0) 00000100:00100000:1.0:1787602417.348549:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853628160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602417.348555:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787602417.348579:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853628160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602417.348589:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db211 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602417.348603:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db211 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602417.348641:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853628288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.348665:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602417.348678:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948180 going to sleep for 11 seconds 00000100:00100000:1.0:1787602417.348688:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853628288 00000100:00100000:1.0:1787602417.348691:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853628288 00000100:00100000:1.0:1787602417.348707:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787602417.348712:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853628288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.348928:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853628288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602417.348935:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787602417.348962:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853628288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.348984:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853628416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.349015:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602417.349027:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948180 going to sleep for 11 seconds 00000100:00100000:1.0:1787602417.349037:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853628416 00000100:00100000:1.0:1787602417.349040:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853628416 00000100:00100000:1.0:1787602417.349057:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787602417.349062:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853628416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.349183:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853628416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602417.349189:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787602417.349229:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853628416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.349414:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8469:1874436853628544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602417.349448:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602417.349467:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853628544 00000100:00100000:1.0:1787602417.349470:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853628544 00000100:00100000:1.0:1787602417.349488:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787602417.349493:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:8469:x1874436853628544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602417.349626:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:8469:x1874436853628544:12345-0@lo:502:llog_process_th.0 Request processed in 132us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602417.349633:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787602417.349660:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948240 going to sleep for 11 seconds 00000100:00100000:1.0:1787602417.349672:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8469:1874436853628544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787602417.349690:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787602417.349699:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602417.349701:0:8469:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787602417.349707:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787602417.349725:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8469:1874436853628672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602417.355542:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602417.355614:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503365780 going to sleep for 11 seconds 00000100:00100000:2.0:1787602417.355688:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853628672 00000100:00100000:2.0:1787602417.355699:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853628672 00000100:00100000:2.0:1787602417.355781:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787602417.355793:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:8469:x1874436853628672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602417.356082:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:8469:x1874436853628672:12345-0@lo:502:llog_process_th.0 Request processed in 290us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602417.356090:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787602417.356484:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8469:1874436853628672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787602417.356519:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602417.356526:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602417.356528:0:8469:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787602417.356534:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787602417.356708:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787602417.356728:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787602417.356764:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db211 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.356776:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db211 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602417.356787:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787602417.356789:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d350c9c3370 from 1 10000000:01000000:2.0:1787602417.356792:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787602417.356824:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503703000/0x3640686da09db218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.356832:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3503703000/0x3640686da09db218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.356841:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3503703000/0x3640686da09db218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602417.356872:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c88b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853628800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787602417.356914:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602417.356960:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35351f1540 going to sleep for 11 seconds 00000100:00100000:0.0:1787602417.357059:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853628800 00000100:00100000:0.0:1787602417.357065:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853628800 00000100:00100000:0.0:1787602417.357104:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787602417.357114:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853628800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602417.357125:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602417.357138:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3500031e00/0x3640686da09db21f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db218 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602417.357159:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3500031e00/0x3640686da09db21f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db218 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602417.357169:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3500031e00/0x3640686da09db21f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db218 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602417.357177:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3500031e00, rc 0) 00000100:00100000:0.0:1787602417.357225:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853628800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602417.357232:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787602417.357860:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c88b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853628800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602417.357878:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3503703000/0x3640686da09db218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db21f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602417.357896:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3503703000/0x3640686da09db218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db21f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602417.357957:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853628928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602417.357993:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602417.358035:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503365780 going to sleep for 11 seconds 00000100:00100000:3.0:1787602417.358076:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853628928 00000100:00100000:3.0:1787602417.358082:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853628928 00000100:00100000:3.0:1787602417.358107:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787602417.358115:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853628928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602417.358367:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853628928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (373us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787602417.358374:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787602417.358520:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853628928:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787602417.358549:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787602417.358560:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503703000/0x3640686da09db218 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db21f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602417.358571:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3503703000/0x3640686da09db218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db21f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602417.368494:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602417.368591:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833678080 00000100:00100000:2.0:1787602417.368606:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833678080 00000100:00100000:2.0:1787602417.368672:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 164 00000100:00100000:2.0:1787602417.368684:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+8:5593:x1874436833678080:12345-192.168.201.26@tcp:101: 00010000:00010000:2.0:1787602417.368707:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602417.368728:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3503703c00/0x3640686da09db226 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c22bb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.368796:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503703c00/0x3640686da09db226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22bb expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.368807:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3503703c00/0x3640686da09db226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22bb expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.368817:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503703c00, rc 0) 00000100:00100000:2.0:1787602417.368882:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:5593:x1874436833678080:12345-192.168.201.26@tcp:101: Request processed in 200us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602417.368890:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 164 00000100:00100000:3.0:1787602417.383899:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602417.384189:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833678208 00000100:00100000:2.0:1787602417.384203:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833678208 00000100:00100000:2.0:1787602417.384279:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 165 00000100:00100000:2.0:1787602417.384290:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:5593:x1874436833678208:12345-192.168.201.26@tcp:501: 00000100:00100000:2.0:1787602417.384609:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:5593:x1874436833678208:12345-192.168.201.26@tcp:501: Request processed in 320us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602417.384618:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 165 00000100:00100000:1.0:1787602417.390428:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602417.390581:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833678336 00000100:00100000:0.0:1787602417.390593:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833678336 00000100:00100000:0.0:1787602417.390675:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 166 00000100:00100000:0.0:1787602417.390685:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:5593:x1874436833678336:12345-192.168.201.26@tcp:503: 00000100:00100000:0.0:1787602417.390970:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:5593:x1874436833678336:12345-192.168.201.26@tcp:503: Request processed in 286us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602417.390978:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 166 00000100:00100000:3.0:1787602417.393819:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602417.393904:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833678464 00000100:00100000:2.0:1787602417.393915:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833678464 00000100:00100000:2.0:1787602417.395338:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 167 00000100:00100000:2.0:1787602417.395357:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:6067:x1874436833678464:12345-192.168.201.26@tcp:502: 00000100:00100000:2.0:1787602417.398322:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:6067:x1874436833678464:12345-192.168.201.26@tcp:502: Request processed in 2957us (4499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602417.398337:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 167 00000100:00100000:0.0:1787602417.401494:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602417.401555:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833678592 00000100:00100000:3.0:1787602417.401570:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833678592 00000100:00100000:3.0:1787602417.401637:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 168 00000100:00100000:3.0:1787602417.401646:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:6067:x1874436833678592:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787602417.402103:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:6067:x1874436833678592:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 456us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602417.402112:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 168 00000100:00100000:1.0:1787602417.422624:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602417.423154:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833678720 00000100:00100000:2.0:1787602417.423166:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833678720 00000100:00100000:2.0:1787602417.423245:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 169 00000100:00100000:2.0:1787602417.423256:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:5593:x1874436833678720:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602417.423274:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602417.423291:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3503703a00/0x3640686da09db22d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c22c2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.423319:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503703a00/0x3640686da09db22d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22c2 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.423341:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3503703a00/0x3640686da09db22d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22c2 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602417.423352:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503703a00, rc 0) 00000100:00100000:2.0:1787602417.423540:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5593:x1874436833678720:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 Request processed in 284us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602417.423547:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 169 00000100:00100000:1.0:1787602417.425980:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602417.426061:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833678848 00000100:00100000:3.0:1787602417.426070:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833678848 00000100:00100000:3.0:1787602417.426125:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 170 00000100:00100000:3.0:1787602417.426149:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5593:x1874436833678848:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602417.426494:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5593:x1874436833678848:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 Request processed in 345us (523us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787602417.426503:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 170 00010000:00010000:0.0:1787602418.349060:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602418.807332:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602418.807356:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853629056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602418.807429:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602418.808113:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853629056 00000100:00100000:0.0:1787602418.808123:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853629056 00000100:00100000:0.0:1787602418.808196:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787602418.808208:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853629056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602418.808245:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602418.808309:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853629056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602418.808316:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787602418.808393:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35378f7480 x1874436853629056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602418.808413:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853629056:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787602418.809305:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1787602419.249222:0:8506:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffedbdf8e20 20000000:00000080:1.0:1787602419.249243:0:8506:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d3404370800 uarg=0000000000000000 20000000:01000000:1.0:1787602419.249284:0:8506:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787602419.249290:0:8506:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787602419.249295:0:8506:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787602419.252714:0:8507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787602419.253111:0:8506:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787602419.257925:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787602419.257982:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787602419.258036:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787602419.258055:0:8506:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787602419.258077:0:8506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d353d433a00/0x3640686da09db234 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602419.258095:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3528f21000/0x3640686da09dafa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dafa2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602419.258104:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3511046600/0x3640686da09db00b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db004 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602419.258111:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3528f20200/0x3640686da09db0d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db0cf expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602419.258119:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d353d432200/0x3640686da09db193 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c228a expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602419.258125:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d353d433a00/0x3640686da09db234 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602419.258180:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d353d432200/0x3640686da09db193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c228a expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602419.258196:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d353d432200/0x3640686da09db193 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c228a expref: 9 pid: 5831 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602419.258210:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1874436853629184:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602419.258316:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3528f20200/0x3640686da09db0d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db0cf expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602419.258324:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3528f20200/0x3640686da09db0d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db0cf expref: 18 pid: 5831 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602419.258333:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1874436853629312:0@lo:104: 00000100:00100000:3.0:1787602419.258378:0:8506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787602419.258416:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3511046600/0x3640686da09db00b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db004 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602419.258425:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3511046600/0x3640686da09db00b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db004 expref: 18 pid: 5829 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602419.258433:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1874436853629440:0@lo:104: 00000100:00100000:3.0:1787602419.258457:0:8506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787602419.258483:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3528f21000/0x3640686da09dafa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09dafa2 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602419.258491:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3528f21000/0x3640686da09dafa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09dafa2 expref: 18 pid: 5831 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602419.258510:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1874436853629568:0@lo:104: 00000100:00100000:3.0:1787602419.258532:0:8506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3536ba6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787602419.259494:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787602419.259518:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602419.259533:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853629312 00000100:00100000:1.0:1787602419.259542:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853629312 00000100:00100000:1.0:1787602419.259593:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853629440 00000100:00100000:1.0:1787602419.259596:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853629440 00000100:00100000:1.0:1787602419.259607:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853629568 00000100:00100000:1.0:1787602419.259609:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853629568 00000100:00100000:1.0:1787602419.259623:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787602419.259631:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+5:8506:x1874436853629312:12345-0@lo:104: 00010000:00010000:1.0:1787602419.259644:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3511047600/0x3640686da09db0cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db0d6 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.259708:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602419.259714:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+5:8506:x1874436853629312:12345-0@lo:104: Request processed in 84us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602419.259720:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787602419.259738:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787602419.259767:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354a6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+4:8506:x1874436853629440:12345-0@lo:104: 00010000:00010000:1.0:1787602419.259775:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db004 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db00b expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.259830:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787602419.259835:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354a6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+4:8506:x1874436853629440:12345-0@lo:104: Request processed in 92us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602419.259841:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787602419.259870:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787602419.259876:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:8506:x1874436853629568:12345-0@lo:104: 00010000:00010000:1.0:1787602419.259883:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09dafa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dafa9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.259925:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787602419.259936:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:8506:x1874436853629568:12345-0@lo:104: Request processed in 61us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602419.259942:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787602419.259959:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787602419.259965:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3511047600/0x3640686da09db0cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db0d6 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.259972:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3511047600 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602419.259975:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3511047600/0x3640686da09db0cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db0d6 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.259983:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3511047600/0x3640686da09db0cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db0d6 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602419.259989:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3511047600/0x3640686da09db0cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db0d6 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602419.259995:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787602419.260026:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3511047600/0x3640686da09db0cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db0d6 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.260031:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602419.260048:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3511047600/0x3640686da09db0cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db0d6 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.260054:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3511047600/0x3640686da09db0cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db0d6 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.260067:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787602419.260070:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db004 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db00b expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.260084:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3528f21e00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602419.260086:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db004 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db00b expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.260092:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db004 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db00b expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602419.260098:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db004 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db00b expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602419.260102:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787602419.260115:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db004 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db00b expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.260121:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602419.260138:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db004 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db00b expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.260145:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db004 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db00b expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.260155:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602419.260158:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09dafa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dafa9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.260163:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3500031000 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602419.260166:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09dafa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09dafa9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.260184:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09dafa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09dafa9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602419.260191:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09dafa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09dafa9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602419.260197:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787602419.260211:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09dafa2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dafa9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.260216:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602419.260222:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09dafa2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dafa9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.260229:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09dafa2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dafa9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.260244:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602419.260246:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602419.260247:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602419.260269:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853629824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787602419.260301:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602419.260332:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602419.260338:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853629952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787602419.260358:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602419.260573:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1874436853629312:0@lo:104: 00000100:00100000:3.0:1787602419.260583:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074cb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1874436853629440:0@lo:104: 00000100:00100000:3.0:1787602419.260591:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1874436853629568:0@lo:104: 00010000:00010000:0.0:1787602419.260787:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602419.260959:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602419.260970:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853629696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787602419.261001:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602419.261039:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853629824 00000100:00100000:2.0:1787602419.261044:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853629824 00010000:00010000:2.0:1787602419.261066:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3511046600/0x3640686da09db00b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db004 expref: 19 pid: 5829 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602419.261083:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853629952 00000100:00100000:2.0:1787602419.261085:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853629952 00010000:00010000:2.0:1787602419.261095:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3528f21000/0x3640686da09dafa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dafa2 expref: 20 pid: 5831 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602419.261103:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853629696 00000100:00100000:2.0:1787602419.261105:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853629696 00010000:00010000:2.0:1787602419.261114:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3528f20200/0x3640686da09db0d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db0cf expref: 21 pid: 5831 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602419.261123:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787602419.261130:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+21:3301:x1874436853629824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787602419.261140:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602419.261144:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3511046600/0x3640686da09db00b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db004 expref: 21 pid: 5829 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.261152:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3511046600/0x3640686da09db00b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db004 expref: 21 pid: 5829 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.261166:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3511046600/0x3640686da09db00b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db004 expref: 21 pid: 5829 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.261180:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602419.261218:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+20:3301:x1874436853629824:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602419.261224:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787602419.261238:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787602419.261243:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853629952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787602419.261249:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602419.261254:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3528f21000/0x3640686da09dafa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dafa2 expref: 19 pid: 5831 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.261261:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3528f21000/0x3640686da09dafa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09dafa2 expref: 19 pid: 5831 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.261271:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3528f21000/0x3640686da09dafa9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09dafa2 expref: 19 pid: 5831 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.261279:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602419.261298:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:3301:x1874436853629952:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602419.261303:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787602419.261314:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787602419.261320:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:3304:x1874436853629696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787602419.261326:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602419.261330:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3528f20200/0x3640686da09db0d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db0cf expref: 17 pid: 5831 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.261337:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3528f20200/0x3640686da09db0d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db0cf expref: 17 pid: 5831 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.261345:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3528f20200/0x3640686da09db0d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db0cf expref: 17 pid: 5831 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.261358:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602419.261384:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:3304:x1874436853629696:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602419.261390:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787602419.261415:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853629696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602419.261581:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853629952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602419.261590:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853629824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602419.271219:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1874436853629184:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602419.271258:0:8506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d353d433a00/0x3640686da09db234 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602419.273044:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602419.273505:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833678976 00000100:00100000:2.0:1787602419.273516:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833678976 00010000:00010000:2.0:1787602419.273554:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d353d432200/0x3640686da09db193 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c228a expref: 10 pid: 5831 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602419.273598:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:2.0:1787602419.273608:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2351:x1874436833678976:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602419.273622:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602419.273628:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d353d432200/0x3640686da09db193 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c228a expref: 10 pid: 5831 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.273640:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d353d432200/0x3640686da09db193 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c228a expref: 10 pid: 5831 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.273668:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d353d432200/0x3640686da09db193 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c228a expref: 10 pid: 5831 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.273684:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d353d433a00/0x3640686da09db234 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.273691:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d433a00/0x3640686da09db234 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.273724:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d353d433a00/0x3640686da09db234 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.273730:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d353d433a00/0x3640686da09db234 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.273737:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d353d433a00/0x3640686da09db234 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.273989:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d353d433a00/0x3640686da09db234 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.273997:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433a00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602419.274001:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d353d433a00/0x3640686da09db234 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.274009:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d353d433a00/0x3640686da09db234 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.274031:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d353d433a00/0x3640686da09db234 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602419.274041:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602419.274101:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:2351:x1874436833678976:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 493us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602419.274108:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 24 00010000:00010000:3.0:1787602419.274315:0:8506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d353d433a00/0x3640686da09db234 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602419.274324:0:8506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d353d433a00/0x3640686da09db234 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602419.274330:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d353d433a00/0x3640686da09db234 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602419.373205:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602419.407913:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602419.408096:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833679104 00000100:00100000:0.0:1787602419.408107:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833679104 00000100:00100000:0.0:1787602419.408162:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 171 00000100:00100000:0.0:1787602419.408173:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:5593:x1874436833679104:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602419.408190:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602419.408208:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3500030000/0x3640686da09db23b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c22c9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602419.408234:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3500030000/0x3640686da09db23b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22c9 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602419.408246:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3500030000/0x3640686da09db23b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22c9 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602419.408263:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3500030000, rc 0) 00000100:00100000:0.0:1787602419.408315:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5593:x1874436833679104:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 Request processed in 144us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602419.408321:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 171 00000100:00100000:0.0:1787602419.417625:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602419.417699:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833679232 00000100:00100000:2.0:1787602419.417708:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833679232 00000100:00100000:2.0:1787602419.417787:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 172 00000100:00100000:2.0:1787602419.417798:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5593:x1874436833679232:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602419.418117:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5593:x1874436833679232:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 Request processed in 320us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602419.418126:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 172 00000100:00100000:3.0:1787602419.420592:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602419.421032:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833679360 00000100:00100000:2.0:1787602419.421043:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833679360 00000100:00100000:2.0:1787602419.421101:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 173 00000100:00100000:2.0:1787602419.421111:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5593:x1874436833679360:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602419.421334:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:5593:x1874436833679360:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 Request processed in 223us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602419.421342:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 173 00000100:00100000:3.0:1787602419.426130:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602419.426207:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833679488 00000100:00100000:0.0:1787602419.426220:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833679488 00000100:00100000:0.0:1787602419.426278:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 174 00000100:00100000:0.0:1787602419.426289:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:6093:x1874436833679488:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787602419.426544:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:6093:x1874436833679488:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 256us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602419.426553:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 174 00000100:00100000:3.0:1787602419.437350:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602419.437435:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833679616 00000100:00100000:2.0:1787602419.437447:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833679616 00000100:00100000:2.0:1787602419.437511:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 175 00000100:00100000:2.0:1787602419.437525:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:6093:x1874436833679616:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787602419.437797:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:6093:x1874436833679616:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 274us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602419.437805:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 175 00010000:00010000:0.0:1787602420.397979:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787602421.036848:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787602421.036867:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d35271fb800 from 4 10000000:01000000:1.0:1787602421.036873:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787602421.036924:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f21000/0x3640686da09db242 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602421.036937:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3528f21000/0x3640686da09db242 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602421.036962:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3528f21000/0x3640686da09db242 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602421.036992:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853630080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787602421.037077:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602421.037156:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a0f09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602421.037370:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853630080 00000100:00100000:3.0:1787602421.037378:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853630080 00000100:00100000:3.0:1787602421.037438:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787602421.037448:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853630080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602421.037462:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602421.037476:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d353d432e00/0x3640686da09db249 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db242 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602421.037501:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d432e00/0x3640686da09db249 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db242 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602421.037510:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d353d432e00/0x3640686da09db249 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db242 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602421.037520:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432e00, rc 0) 00000100:00100000:3.0:1787602421.037571:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853630080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602421.037578:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787602421.037673:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853630080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602421.037690:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3528f21000/0x3640686da09db242 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db249 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602421.037699:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3528f21000/0x3640686da09db242 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db249 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602421.037774:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853630208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602421.037810:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602421.037828:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a0f09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602421.038157:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853630208 00000100:00100000:3.0:1787602421.038163:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853630208 00000100:00100000:3.0:1787602421.038188:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787602421.038196:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853630208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602421.038462:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853630208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602421.038470:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787602421.038501:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853630208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602421.038531:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853630336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602421.038579:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602421.038615:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a0b4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602421.038633:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853630336 00000100:00100000:3.0:1787602421.038637:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853630336 00000100:00100000:3.0:1787602421.038654:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787602421.038660:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853630336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602421.038837:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853630336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602421.038843:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787602421.038890:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853630336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602421.044570:0:8586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8586:1874436853630464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602421.045370:0:8586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602421.046987:0:8586:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353d594cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602421.048832:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853630464 00000100:00100000:1.0:1787602421.048845:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853630464 00000100:00100000:1.0:1787602421.049060:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787602421.049072:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:8586:x1874436853630464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602421.049462:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:8586:x1874436853630464:12345-0@lo:502:llog_process_th.0 Request processed in 391us (4093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602421.049470:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787602421.049563:0:8586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8586:1874436853630464:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787602421.049597:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602421.049620:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602421.049623:0:8586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787602421.049629:0:8586:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d35271fb800 00000020:00000080:3.0:1787602421.049632:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787602421.049734:0:8586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8586:1874436853630592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602421.049843:0:8586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602421.049884:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853630592 00000100:00100000:3.0:1787602421.049889:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853630592 00000100:00100000:3.0:1787602421.049916:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787602421.049923:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:8586:x1874436853630592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602421.050048:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:8586:x1874436853630592:12345-0@lo:502:llog_process_th.0 Request processed in 125us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602421.050055:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787602421.050095:0:8586:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35088b0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787602421.050106:0:8586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8586:1874436853630592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787602421.050314:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602421.050325:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602421.050326:0:8586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787602421.050330:0:8586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787602421.066985:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787602421.067027:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602421.067041:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f21000/0x3640686da09db242 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db249 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602421.067056:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3528f21000/0x3640686da09db242 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db249 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602421.067068:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787602421.067078:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d353d79c800 from 4 10000000:01000000:0.0:1787602421.067081:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602421.067134:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db250 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602421.067143:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db250 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602421.067154:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db250 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602421.067181:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853630720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602421.067259:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602421.067303:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353d594cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602421.067416:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853630720 00000100:00100000:0.0:1787602421.067424:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853630720 00000100:00100000:0.0:1787602421.067487:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787602421.067497:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853630720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602421.067512:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602421.067525:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3500030400/0x3640686da09db257 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db250 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602421.067551:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3500030400/0x3640686da09db257 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db250 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602421.067560:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3500030400/0x3640686da09db257 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db250 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602421.067569:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3500030400, rc 0) 00000100:00100000:0.0:1787602421.067607:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853630720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602421.067621:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787602421.067667:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853630720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602421.067682:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db250 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db257 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602421.067691:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db250 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db257 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602421.069837:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853630848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602421.069907:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602421.069932:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353d594cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602421.070132:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853630848 00000100:00100000:0.0:1787602421.070141:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853630848 00000100:00100000:0.0:1787602421.070182:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787602421.070191:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853630848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602421.070450:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853630848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602421.070457:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787602421.070505:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853630848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602421.070542:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853630976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602421.070581:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602421.070597:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602421.070610:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853630976 00000100:00100000:0.0:1787602421.070614:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853630976 00000100:00100000:0.0:1787602421.070636:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787602421.070650:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853630976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602421.070830:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853630976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602421.070838:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787602421.070877:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853630976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602421.071070:0:8589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8589:1874436853631104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602421.071107:0:8589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602421.071128:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853631104 00000100:00100000:0.0:1787602421.071131:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853631104 00000100:00100000:0.0:1787602421.071152:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787602421.071158:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:8589:x1874436853631104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602421.071282:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:8589:x1874436853631104:12345-0@lo:502:llog_process_th.0 Request processed in 123us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602421.071289:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787602421.071316:0:8589:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602421.071326:0:8589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8589:1874436853631104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787602421.071347:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787602421.071357:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602421.071360:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787602421.071368:0:8589:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d353d79c800 00000020:00000080:0.0:1787602421.071370:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787602421.077093:0:8589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8589:1874436853631232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602421.077306:0:8589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602421.077350:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853631232 00000100:00100000:0.0:1787602421.077358:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853631232 00000100:00100000:0.0:1787602421.077414:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787602421.077423:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:8589:x1874436853631232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602421.077651:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:8589:x1874436853631232:12345-0@lo:502:llog_process_th.0 Request processed in 228us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602421.077658:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787602421.077712:0:8589:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602421.077840:0:8589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8589:1874436853631232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787602421.077931:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602421.077940:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602421.077942:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787602421.077947:0:8589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787602421.078013:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787602421.078033:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602421.078046:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db250 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db257 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602421.078056:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db257 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602421.078066:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787602421.078068:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3509288800 from 4 10000000:01000000:0.0:1787602421.078071:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602421.078096:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db25e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602421.078103:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db25e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602421.078935:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db25e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602421.078967:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853631360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602421.079020:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602421.080000:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602421.084850:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853631360 00000100:00100000:2.0:1787602421.085191:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853631360 00000100:00100000:2.0:1787602421.085261:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787602421.085273:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853631360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602421.085295:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602421.085314:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3503703e00/0x3640686da09db265 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db25e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602421.085358:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503703e00/0x3640686da09db265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db25e expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602421.085371:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3503703e00/0x3640686da09db265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db25e expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602421.085380:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503703e00, rc 0) 00000100:00100000:2.0:1787602421.085470:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853631360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (6448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602421.085477:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787602421.085549:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853631360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602421.085567:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db25e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db265 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602421.085577:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db25e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db265 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602421.085655:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c888700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853631488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602421.085689:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602421.086848:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32840 going to sleep for 11 seconds 00000100:00100000:2.0:1787602421.087839:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853631488 00000100:00100000:2.0:1787602421.087851:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853631488 00000100:00100000:2.0:1787602421.087973:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787602421.087984:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853631488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602421.090873:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853631488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2873us (5165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602421.090895:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787602421.091686:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c888700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853631488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602421.091738:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853631616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602421.091820:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602421.091854:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35088b0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602421.092305:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853631616 00000100:00100000:2.0:1787602421.092312:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853631616 00000100:00100000:2.0:1787602421.092357:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787602421.092365:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853631616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602421.092528:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853631616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602421.092535:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787602421.093551:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853631616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602421.094177:0:8592:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8592:1874436853631744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602421.094233:0:8592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602421.094276:0:8592:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edf480 going to sleep for 11 seconds 00000100:00100000:2.0:1787602421.094382:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853631744 00000100:00100000:2.0:1787602421.094389:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853631744 00000100:00100000:2.0:1787602421.094430:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787602421.094440:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:8592:x1874436853631744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602421.094635:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:8592:x1874436853631744:12345-0@lo:502:llog_process_th.0 Request processed in 196us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602421.094642:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787602421.094686:0:8592:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8592:1874436853631744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787602421.094721:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602421.094730:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602421.094732:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787602421.094740:0:8592:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3509288800 00000020:00000080:2.0:1787602421.094768:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787602421.095174:0:8592:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c88a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8592:1874436853631872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602421.095211:0:8592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602421.095231:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853631872 00000100:00100000:2.0:1787602421.095236:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853631872 00000100:00100000:2.0:1787602421.095254:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787602421.095267:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:8592:x1874436853631872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602421.095388:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:8592:x1874436853631872:12345-0@lo:502:llog_process_th.0 Request processed in 120us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602421.095394:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787602421.095423:0:8592:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32900 going to sleep for 11 seconds 00000100:00100000:2.0:1787602421.095435:0:8592:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c88a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:8592:1874436853631872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787602421.095454:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602421.095457:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602421.095459:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787602421.095462:0:8592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787602421.095514:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787602421.095535:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787602421.095544:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db25e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db265 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602421.095555:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db25e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db265 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602421.359698:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853632000:0@lo:400:kworker.0 00000100:00100000:1.0:1787602421.359701:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853632384:0@lo:400:kworker.0 00000100:00100000:3.0:1787602421.359770:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853632128:0@lo:400:kworker.0 00000100:00100000:2.0:1787602421.359882:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602421.359951:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853632512:0@lo:400:kworker.0 00000100:00100000:2.0:1787602421.359979:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602421.360020:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853632000 00000100:00100000:2.0:1787602421.360027:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853632000 00000100:00100000:2.0:1787602421.360072:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787602421.360082:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853632000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602421.360134:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853632000:12345-0@lo:400:kworker.0 Request processed in 53us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602421.360147:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787602421.360174:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853632512 00000100:00100000:2.0:1787602421.360178:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853632512 00000100:00100000:2.0:1787602421.360214:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787602421.360221:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853632512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602421.360254:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853632512:12345-0@lo:400:kworker.0 Request processed in 34us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602421.360261:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787602421.360280:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787602421.360310:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35351c4380 x1874436853632512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602421.360325:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853632512:0@lo:400:kworker.0 00000100:00100000:2.0:1787602421.360337:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853632000:0@lo:400:kworker.0 00000100:00100000:2.0:1787602421.360839:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853632256:0@lo:400:kworker.0 00000100:00100000:2.0:1787602421.360878:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602421.360913:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853632256 00000100:00100000:2.0:1787602421.360918:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853632256 00000100:00100000:2.0:1787602421.360953:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787602421.361223:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853632256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602421.361271:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853632256:12345-0@lo:400:kworker.0 Request processed in 312us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602421.361279:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787602421.361299:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787602421.361319:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35351c7100 x1874436853632256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602421.361349:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853632256:0@lo:400:kworker.0 00000100:00100000:1.0:1787602421.361960:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602421.362017:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853632384 00000100:00100000:1.0:1787602421.362022:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853632384 00000100:00100000:3.0:1787602421.362048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787602421.362079:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602421.366273:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853632128 00000100:00100000:1.0:1787602421.366287:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853632128 00000100:00100000:1.0:1787602421.366373:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787602421.366383:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853632384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602421.366475:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853632384:12345-0@lo:400:kworker.0 Request processed in 94us (4524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602421.366482:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787602421.366499:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787602421.366504:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853632128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602421.366537:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853632128:12345-0@lo:400:kworker.0 Request processed in 33us (4490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602421.366542:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787602421.366813:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853632128:0@lo:400:kworker.0 00000100:00080000:0.0:1787602421.369778:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602421.369979:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853632384:0@lo:400:kworker.0 00010000:00010000:0.0:1787602421.421163:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602421.460457:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602421.460511:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602421.460550:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602421.460582:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602421.460715:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833680000 00000100:00100000:0.0:1787602421.460725:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833680000 00000100:00100000:0.0:1787602421.460823:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833680128 00000100:00100000:0.0:1787602421.460826:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833680128 00000100:00100000:2.0:1787602421.460833:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833679744 00000100:00100000:2.0:1787602421.460837:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833679744 00000100:00100000:0.0:1787602421.460845:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:2.0:1787602421.460865:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 191 00000100:00100000:0.0:1787602421.460866:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833680000:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602421.460871:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2354:x1874436833679744:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602421.460934:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2354:x1874436833679744:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 62us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602421.460942:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 191 00000100:00100000:1.0:1787602421.460946:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833679872 00000100:00100000:1.0:1787602421.460949:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833679872 00000100:00100000:1.0:1787602421.460990:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:1.0:1787602421.460998:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2354:x1874436833679872:12345-192.168.201.26@tcp:400:kworker.0 00000100:00080000:3.0:1787602421.461119:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787602421.461124:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787602421.461127:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787602421.461138:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787602421.461147:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787602421.461210:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833680000:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 344us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602421.461217:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:0.0:1787602421.461233:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:0.0:1787602421.461239:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833680128:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602421.461263:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833680128:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 25us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602421.461269:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:1.0:1787602421.467993:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2354:x1874436833679872:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 6981us (7427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602421.468022:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:3.0:1787602421.869497:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853632640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602421.869576:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602421.869679:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853632640 00000100:00100000:0.0:1787602421.869689:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853632640 00000100:00100000:0.0:1787602421.869761:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787602421.869801:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853632640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787602421.869840:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602421.877699:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853632640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7889us (8111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602421.877715:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787602421.877914:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d350c888e00 x1874436853632640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602421.877942:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853632640:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787602422.462262:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602423.469298:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602423.919982:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787602423.920003:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853632768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602423.920075:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602423.920145:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853632768 00000100:00100000:1.0:1787602423.920151:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853632768 00000100:00100000:1.0:1787602423.920343:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787602423.920355:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853632768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787602423.920388:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602423.920430:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853632768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602423.920437:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787602423.920455:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787602423.920484:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35351c5500 x1874436853632768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602423.920500:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853632768:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787602424.492945:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602425.520529:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787602425.914055:0:8807:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1787602426.477171:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853632896:0@lo:400:kworker.0 00000100:00100000:1.0:1787602426.477254:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602426.477321:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853633408:0@lo:400:kworker.0 00000100:00100000:1.0:1787602426.477349:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602426.477369:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787602426.477374:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853633280:0@lo:400:kworker.0 00000100:00100000:1.0:1787602426.477399:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602426.477451:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853633024:0@lo:400:kworker.0 00000100:00100000:1.0:1787602426.477453:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853633280 00000100:00100000:1.0:1787602426.477460:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853633280 00000100:00100000:0.0:1787602426.477481:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602426.477517:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787602426.477526:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853633280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602426.477577:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853633280:12345-0@lo:400:kworker.0 Request processed in 51us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602426.477584:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787602426.477594:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853632896 00000100:00100000:2.0:1787602426.477599:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853632896 00000100:00080000:1.0:1787602426.477603:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602426.477623:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00010000:00080000:1.0:1787602426.477628:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d350c889c00 x1874436853633280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602426.477629:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853632896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602426.477642:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853633280:0@lo:400:kworker.0 00000100:00100000:2.0:1787602426.477660:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853632896:12345-0@lo:400:kworker.0 Request processed in 31us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602426.477661:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853632896:0@lo:400:kworker.0 00000100:00100000:2.0:1787602426.477666:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787602426.477702:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853633408 00000100:00100000:1.0:1787602426.477705:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853633408 00000100:00100000:1.0:1787602426.477735:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853633024 00000100:00100000:1.0:1787602426.477738:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853633024 00000100:00100000:0.0:1787602426.477799:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853633536:0@lo:400:kworker.0 00000100:00100000:0.0:1787602426.477827:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602426.477861:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787602426.477867:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853633152:0@lo:400:kworker.0 00000100:00100000:0.0:1787602426.477888:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602426.477919:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853633152 00000100:00100000:0.0:1787602426.477923:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853633152 00000100:00100000:0.0:1787602426.477944:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787602426.477950:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853633408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602426.477985:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853633408:12345-0@lo:400:kworker.0 Request processed in 34us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602426.477991:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787602426.478099:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787602426.478108:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853633152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602426.478156:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853633152:12345-0@lo:400:kworker.0 Request processed in 50us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602426.478162:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787602426.478181:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853633536 00000100:00100000:2.0:1787602426.478184:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853633536 00000100:00100000:2.0:1787602426.478205:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787602426.478648:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787602426.478653:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602426.478813:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853633536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602426.478881:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787602426.478888:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853633024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602426.478920:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853633152:0@lo:400:kworker.0 00000100:00100000:1.0:1787602426.478922:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853633024:12345-0@lo:400:kworker.0 Request processed in 35us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602426.478928:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787602426.478937:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853633024:0@lo:400:kworker.0 00000100:00100000:1.0:1787602426.478957:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853633408:0@lo:400:kworker.0 00000100:00100000:2.0:1787602426.478965:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853633536:12345-0@lo:400:kworker.0 Request processed in 158us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602426.478972:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787602426.479068:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d350c88ad80 x1874436853633536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602426.479087:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853633536:0@lo:400:kworker.0 00010000:00010000:2.0:1787602426.541241:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602426.588031:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602426.588093:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602426.588134:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602426.588164:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602426.588198:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833680512 00000100:00100000:3.0:1787602426.588207:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833680512 00000100:00100000:3.0:1787602426.588273:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833680640 00000100:00100000:3.0:1787602426.588276:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833680640 00000100:00100000:3.0:1787602426.588298:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:3.0:1787602426.588308:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2351:x1874436833680512:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602426.588402:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2351:x1874436833680512:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 95us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602426.588411:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:3.0:1787602426.588428:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:3.0:1787602426.588435:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2351:x1874436833680640:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602426.588459:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2351:x1874436833680640:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 25us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602426.588465:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00080000:3.0:1787602426.588572:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787602426.588577:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602426.588909:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833680384 00000100:00100000:0.0:1787602426.588916:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833680384 00000100:00100000:0.0:1787602426.588969:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 37 00000100:00100000:0.0:1787602426.588979:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2351:x1874436833680384:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602426.589035:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2351:x1874436833680384:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 58us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602426.589042:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 37 00000100:00100000:2.0:1787602426.589122:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833680256 00000100:00100000:2.0:1787602426.589138:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833680256 00000100:00100000:2.0:1787602426.589176:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 193 00000100:00100000:2.0:1787602426.589183:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2351:x1874436833680256:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602426.589218:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2351:x1874436833680256:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 35us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602426.589224:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 193 00000100:00080000:3.0:1787602426.589543:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602426.990074:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853633664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602426.990178:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602426.990449:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853633664 00000100:00100000:0.0:1787602426.990461:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853633664 00000100:00100000:0.0:1787602426.990542:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787602426.990555:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853633664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787602426.990603:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602426.990664:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853633664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602426.990673:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787602426.990929:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35378f7480 x1874436853633664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602426.990953:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853633664:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787602427.567715:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602428.592233:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602429.038356:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787602429.038381:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853633792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602429.038455:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602429.039103:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853633792 00000100:00100000:0.0:1787602429.039113:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853633792 00000100:00100000:0.0:1787602429.039188:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787602429.039201:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853633792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602429.039240:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602429.039293:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853633792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602429.039316:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787602429.039384:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787602429.039473:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35378f7800 x1874436853633792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602429.039498:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853633792:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787602429.617062:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602430.637193:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602431.598818:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853633920:0@lo:400:kworker.0 00000100:00100000:2.0:1787602431.600680:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602431.600738:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853634432:0@lo:400:kworker.0 00000100:00100000:2.0:1787602431.600775:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602431.600802:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787602431.600808:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853634304:0@lo:400:kworker.0 00000100:00100000:2.0:1787602431.601936:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602431.601984:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853634048:0@lo:400:kworker.0 00000100:00100000:2.0:1787602431.602011:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602431.602027:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853634560:0@lo:400:kworker.0 00000100:00100000:2.0:1787602431.602044:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602431.602061:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602431.602065:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853634176:0@lo:400:kworker.0 00000100:00100000:2.0:1787602431.602081:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602431.602108:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853633920 00000100:00100000:2.0:1787602431.602115:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853633920 00000100:00100000:2.0:1787602431.602155:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787602431.602162:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853633920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602431.602206:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853633920:12345-0@lo:400:kworker.0 Request processed in 45us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602431.602214:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787602431.602242:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853634432 00000100:00100000:2.0:1787602431.602244:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853634432 00000100:00100000:2.0:1787602431.602279:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853634048 00000100:00100000:2.0:1787602431.602282:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853634048 00000100:00100000:2.0:1787602431.602293:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853634176 00000100:00100000:2.0:1787602431.602294:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853634176 00000100:00100000:2.0:1787602431.602306:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787602431.602311:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853634432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602431.602338:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853634432:12345-0@lo:400:kworker.0 Request processed in 27us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602431.602344:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787602431.602353:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787602431.602365:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853634048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602431.602390:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853634048:12345-0@lo:400:kworker.0 Request processed in 25us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602431.602395:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787602431.602405:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787602431.602410:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853634176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602431.602429:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853634176:12345-0@lo:400:kworker.0 Request processed in 19us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602431.602434:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787602431.602447:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853634304 00000100:00100000:2.0:1787602431.602450:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853634304 00000100:00100000:2.0:1787602431.602469:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853634560 00000100:00100000:2.0:1787602431.602471:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853634560 00000100:00100000:2.0:1787602431.602485:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787602431.602490:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853634304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602431.602514:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c888700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853634304:12345-0@lo:400:kworker.0 Request processed in 24us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602431.602520:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787602431.602528:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787602431.602532:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853634560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602431.602551:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c889500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853634560:12345-0@lo:400:kworker.0 Request processed in 18us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602431.602556:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787602431.602579:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787602431.602583:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787602431.602585:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602431.602634:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853634176:0@lo:400:kworker.0 00000100:00100000:2.0:1787602431.602654:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853634048:0@lo:400:kworker.0 00010000:00080000:2.0:1787602431.602665:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d350c889c00 x1874436853634560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602431.602675:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853634560:0@lo:400:kworker.0 00010000:00080000:2.0:1787602431.602705:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d350c888a80 x1874436853634304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602431.602715:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853634304:0@lo:400:kworker.0 00000100:00100000:2.0:1787602431.602725:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853633920:0@lo:400:kworker.0 00000100:00100000:2.0:1787602431.602735:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853634432:0@lo:400:kworker.0 00000001:02000400:1.0:1787602431.645433:0:9052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing yml_node 00010000:00010000:0.0:1787602431.666474:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602431.714226:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602431.714267:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602431.714297:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602431.714324:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602431.714350:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833681024 00000100:00100000:2.0:1787602431.714360:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833681024 00000100:00100000:2.0:1787602431.714418:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833681152 00000100:00100000:2.0:1787602431.714420:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833681152 00000100:00100000:2.0:1787602431.714441:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:2.0:1787602431.714450:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2350:x1874436833681024:12345-192.168.201.26@tcp:9:kworker.0 00000020:00000080:2.0:1787602431.714487:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db1a1 00000100:00080000:2.0:1787602431.714497:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8d35351e4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787602431.714739:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787602431.714773:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833680896 00000100:00100000:1.0:1787602431.714779:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833680896 00000100:00100000:1.0:1787602431.714821:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 41 00000100:00100000:1.0:1787602431.714830:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2354:x1874436833680896:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602431.714916:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2354:x1874436833680896:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 86us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602431.714925:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 41 00000100:00100000:3.0:1787602431.715358:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833680768 00000100:00100000:3.0:1787602431.715365:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833680768 00000100:00100000:3.0:1787602431.715415:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 195 00000100:00100000:3.0:1787602431.715424:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2354:x1874436833680768:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602431.715468:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2354:x1874436833680768:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 45us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602431.715475:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 195 00000100:00100000:3.0:1787602431.715734:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:3.0:1787602431.715774:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2350:x1874436833681152:12345-192.168.201.26@tcp:9:kworker.0 00000020:00000080:3.0:1787602431.715799:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db1a8 00000100:00080000:3.0:1787602431.715808:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8d34049c8800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787602431.715926:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787602431.716028:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787602431.716310:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+2:2350:x1874436833681152:12345-192.168.201.26@tcp:9:kworker.0 Request processed in 566us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602431.716318:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00080000:3.0:1787602431.716341:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787602431.716347:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787602431.716350:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787602431.716409:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602431.718423:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+2:2350:x1874436833681024:12345-192.168.201.26@tcp:9:kworker.0 Request processed in 3964us (4114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602431.718446:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:2.0:1787602432.113344:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853634688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602432.113435:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602432.116560:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853634688 00000100:00100000:0.0:1787602432.116576:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853634688 00000100:00100000:0.0:1787602432.116650:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787602432.116660:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853634688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787602432.116711:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602432.116812:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c889c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853634688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (3388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602432.116820:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787602432.116869:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35378f7b80 x1874436853634688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602432.116892:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853634688:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1787602432.164359:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e3aefeab-67b4-4a0a-9090-6916c4553638 00000020:00000080:0.0:1787602432.164368:0:6714:0:(genops.c:885:class_export_put()) final put ffff8d35351e6000/e3aefeab-67b4-4a0a-9090-6916c4553638 00000020:00000080:0.0:1787602432.164389:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d35351e6000/e3aefeab-67b4-4a0a-9090-6916c4553638 for lustre-OST0000 00000020:00000080:0.0:1787602432.164422:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d35351e4800 for lustre-OST0000 00010000:00010000:0.0:1787602432.695914:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602433.709012:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602434.158073:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853634816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602434.158194:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602434.158301:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853634816 00000100:00100000:0.0:1787602434.158322:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853634816 00000100:00100000:0.0:1787602434.158400:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787602434.158410:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853634816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602434.158448:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602434.158541:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853634816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602434.158576:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787602434.158670:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35378f7b80 x1874436853634816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602434.158699:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853634816:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787602434.158725:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787602434.735221:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602435.757356:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787602436.297840:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e3aefeab-67b4-4a0a-9090-6916c4553638 00000020:00000080:2.0:1787602436.297853:0:7646:0:(genops.c:885:class_export_put()) final put ffff8d34049ca800/e3aefeab-67b4-4a0a-9090-6916c4553638 00000020:00000080:1.0:1787602436.297983:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d34049ca800/e3aefeab-67b4-4a0a-9090-6916c4553638 for lustre-OST0001 00000020:00000080:1.0:1787602436.298040:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d34049c8800 for lustre-OST0001 00000100:00100000:0.0:1787602436.717802:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853635072:0@lo:400:kworker.0 00000100:00100000:0.0:1787602436.717901:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602436.717971:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853635584:0@lo:400:kworker.0 00000100:00100000:0.0:1787602436.718000:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602436.718032:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787602436.718039:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853635200:0@lo:400:kworker.0 00000100:00100000:0.0:1787602436.718060:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602436.718101:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853635072 00000100:00100000:0.0:1787602436.718110:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853635072 00000100:00100000:0.0:1787602436.718157:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853635200 00000100:00100000:0.0:1787602436.718161:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853635200 00000100:00100000:0.0:1787602436.718193:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787602436.718203:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853635072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602436.718259:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853635072:12345-0@lo:400:kworker.0 Request processed in 57us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602436.718266:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787602436.718283:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787602436.718290:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853635200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602436.718317:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853635200:12345-0@lo:400:kworker.0 Request processed in 28us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602436.718323:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787602436.718341:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602436.718384:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853635200:0@lo:400:kworker.0 00000100:00100000:0.0:1787602436.718395:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853635072:0@lo:400:kworker.0 00000100:00100000:2.0:1787602436.718950:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853635328:0@lo:400:kworker.0 00000100:00100000:2.0:1787602436.718991:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602436.719028:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787602436.719035:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853634944:0@lo:400:kworker.0 00000100:00100000:2.0:1787602436.719064:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602436.719096:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874436853635456:0@lo:400:kworker.0 00000100:00100000:2.0:1787602436.719121:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602436.719185:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853634944 00000100:00100000:1.0:1787602436.719193:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853634944 00000100:00100000:1.0:1787602436.719235:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787602436.719244:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853634944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602436.719288:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853634944:12345-0@lo:400:kworker.0 Request processed in 45us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602436.719295:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787602436.719334:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853634944:0@lo:400:kworker.0 00000100:00100000:0.0:1787602436.719830:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853635584 00000100:00100000:0.0:1787602436.719836:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853635584 00000100:00100000:0.0:1787602436.719879:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853635328 00000100:00100000:0.0:1787602436.719883:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853635328 00000100:00100000:0.0:1787602436.719908:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787602436.719915:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853635584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602436.719961:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853635584:12345-0@lo:400:kworker.0 Request processed in 47us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602436.719968:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787602436.719981:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787602436.719987:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853635328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602436.720019:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853635328:12345-0@lo:400:kworker.0 Request processed in 32us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602436.720025:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787602436.720062:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d350886e300 x1874436853635328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602436.720074:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853635328:0@lo:400:kworker.0 00000100:00100000:0.0:1787602436.720094:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853635456 00000100:00100000:0.0:1787602436.720097:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853635456 00000100:00100000:0.0:1787602436.720124:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787602436.720131:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874436853635456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602436.720168:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874436853635456:12345-0@lo:400:kworker.0 Request processed in 38us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602436.720174:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787602436.720203:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874436853635456:0@lo:400:kworker.0 00010000:00080000:0.0:1787602436.720246:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d65df80 x1874436853635584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602436.720257:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853635584:0@lo:400:kworker.0 00000100:00080000:1.0:1787602436.720441:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787602436.720447:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602436.720449:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787602436.783039:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602436.825599:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602436.825644:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602436.825679:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833681408 00000100:00100000:2.0:1787602436.825688:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833681408 00000100:00100000:2.0:1787602436.825787:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:2.0:1787602436.825798:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2354:x1874436833681408:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602436.825878:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2354:x1874436833681408:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 82us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602436.825886:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00080000:2.0:1787602436.825906:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602436.826288:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833681280 00000100:00100000:3.0:1787602436.826294:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833681280 00000100:00100000:3.0:1787602436.826337:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 197 00000100:00100000:3.0:1787602436.826345:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2354:x1874436833681280:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602436.826384:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2354:x1874436833681280:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 40us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602436.826400:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 197 00000001:02000400:3.0:1787602436.997126:0:9245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.81 00000100:00100000:0.0:1787602437.231031:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853635712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602437.231099:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602437.231389:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853635712 00000100:00100000:0.0:1787602437.231399:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853635712 00000100:00100000:0.0:1787602437.231445:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787602437.231454:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853635712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787602437.231489:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602437.231547:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853635712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602437.231554:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787602437.231635:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35378f4380 x1874436853635712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602437.231655:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853635712:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787602437.806505:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602438.830106:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602439.284061:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602439.284084:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853635840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602439.284152:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602439.284233:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853635840 00000100:00100000:0.0:1787602439.284240:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853635840 00000100:00100000:0.0:1787602439.284292:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787602439.284303:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853635840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602439.284338:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602439.284390:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853635840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602439.284398:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787602439.284445:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35378f4380 x1874436853635840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602439.284465:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853635840:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787602439.284556:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787602439.852868:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787602439.901131:0:9342:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.81 00010000:00010000:3.0:1787602440.877806:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602441.842097:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853635968:0@lo:400:kworker.0 00000100:00100000:0.0:1787602441.842192:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602441.842259:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853636480:0@lo:400:kworker.0 00000100:00100000:0.0:1787602441.842286:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602441.842313:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602441.842319:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853636352:0@lo:400:kworker.0 00000100:00100000:0.0:1787602441.842343:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602441.842374:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853636096:0@lo:400:kworker.0 00000100:00100000:0.0:1787602441.842422:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602441.842454:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853636608:0@lo:400:kworker.0 00000100:00100000:0.0:1787602441.842479:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602441.842510:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787602441.842516:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853636224:0@lo:400:kworker.0 00000100:00100000:0.0:1787602441.842728:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602441.842819:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853636480 00000100:00100000:0.0:1787602441.842830:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853636480 00000100:00100000:0.0:1787602441.842899:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853636096 00000100:00100000:0.0:1787602441.842903:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853636096 00000100:00100000:0.0:1787602441.842917:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853636224 00000100:00100000:0.0:1787602441.842919:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853636224 00000100:00100000:0.0:1787602441.842943:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787602441.842952:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853636480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602441.843011:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853636480:12345-0@lo:400:kworker.0 Request processed in 60us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602441.843019:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787602441.843035:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787602441.843040:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853636096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602441.843065:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853636096:12345-0@lo:400:kworker.0 Request processed in 25us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602441.843070:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787602441.843079:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787602441.843084:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853636224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602441.843105:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853636224:12345-0@lo:400:kworker.0 Request processed in 21us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602441.843110:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787602441.843127:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853636352 00000100:00100000:0.0:1787602441.843130:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853636352 00000100:00100000:0.0:1787602441.843151:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853636608 00000100:00100000:0.0:1787602441.843153:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853636608 00000100:00100000:0.0:1787602441.843180:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787602441.843186:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853636352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602441.843212:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853636352:12345-0@lo:400:kworker.0 Request processed in 27us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602441.843218:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787602441.843226:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787602441.843231:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853636608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602441.843327:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853636608:12345-0@lo:400:kworker.0 Request processed in 95us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602441.843333:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787602441.843383:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853636224:0@lo:400:kworker.0 00000100:00100000:0.0:1787602441.843396:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853636096:0@lo:400:kworker.0 00010000:00080000:0.0:1787602441.843410:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35351c4e00 x1874436853636608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602441.843421:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853636608:0@lo:400:kworker.0 00010000:00080000:0.0:1787602441.843470:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d35378f7480 x1874436853636352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602441.843479:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853636352:0@lo:400:kworker.0 00000100:00100000:0.0:1787602441.843489:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853636480:0@lo:400:kworker.0 00000100:00100000:2.0:1787602441.844059:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853635968 00000100:00100000:2.0:1787602441.844066:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853635968 00000100:00100000:2.0:1787602441.844106:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787602441.844115:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853635968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602441.844172:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853635968:12345-0@lo:400:kworker.0 Request processed in 59us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602441.844179:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:2.0:1787602441.844221:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787602441.844226:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787602441.844230:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602441.844275:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853635968:0@lo:400:kworker.0 00010000:00010000:2.0:1787602441.901071:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602441.940474:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602441.940543:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602441.940595:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833681536 00000100:00100000:0.0:1787602441.940611:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833681536 00000100:00100000:0.0:1787602441.940689:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 199 00000100:00100000:0.0:1787602441.940702:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2351:x1874436833681536:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602441.941056:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2351:x1874436833681536:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 355us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602441.941064:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 199 00000100:00100000:0.0:1787602441.941106:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833681664 00000100:00100000:0.0:1787602441.941110:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833681664 00000100:00100000:0.0:1787602441.941162:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:0.0:1787602441.941169:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2351:x1874436833681664:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602441.941213:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2351:x1874436833681664:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 44us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602441.941220:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00080000:3.0:1787602441.941572:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602442.354954:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853636736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602442.355063:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602442.355174:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853636736 00000100:00100000:2.0:1787602442.355185:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853636736 00000100:00100000:2.0:1787602442.355263:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787602442.355276:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d102680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853636736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787602442.355320:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602442.355374:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d102680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853636736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602442.355382:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787602442.355440:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d100700 x1874436853636736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602442.355481:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853636736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787602442.934111:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787602443.013472:0:9440:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.81 00010000:00010000:3.0:1787602443.953290:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602444.397140:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853636864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602444.397241:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602444.397434:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853636864 00000100:00100000:3.0:1787602444.397445:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853636864 00000100:00100000:3.0:1787602444.397528:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787602444.397539:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853636864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602444.397585:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602444.397644:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d100700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853636864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602444.397653:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787602444.397717:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787602444.398165:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d65c380 x1874436853636864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602444.398214:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853636864:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787602444.974409:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787602445.200546:0:9488:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 24 16:14:04 EDT 2026 00010000:00010000:0.0:1787602446.005522:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602446.959192:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853636992:0@lo:400:kworker.0 00000100:00100000:0.0:1787602446.959294:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602446.966565:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602446.966599:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853637376:0@lo:400:kworker.0 00000100:00100000:0.0:1787602446.966710:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602446.966813:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853636992 00000100:00100000:0.0:1787602446.966825:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853636992 00000100:00100000:0.0:1787602446.966900:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787602446.966911:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853636992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602446.966976:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853636992:12345-0@lo:400:kworker.0 Request processed in 66us (7682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602446.966985:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787602446.967029:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853637376 00000100:00100000:0.0:1787602446.967033:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853637376 00000100:00100000:0.0:1787602446.967074:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787602446.967081:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853637376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602446.967116:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853637376:12345-0@lo:400:kworker.0 Request processed in 36us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602446.967122:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787602446.967162:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534976300 x1874436853637376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602446.967195:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853637376:0@lo:400:kworker.0 00000100:00100000:0.0:1787602446.967207:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853636992:0@lo:400:kworker.0 00000100:00080000:2.0:1787602446.967739:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602446.968842:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853637120:0@lo:400:kworker.0 00000100:00100000:2.0:1787602446.968915:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602446.968964:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602446.968972:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853637248:0@lo:400:kworker.0 00000100:00100000:2.0:1787602446.968996:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602446.969034:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853637120 00000100:00100000:2.0:1787602446.969042:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853637120 00000100:00100000:2.0:1787602446.969084:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853637248 00000100:00100000:2.0:1787602446.969087:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853637248 00000100:00100000:2.0:1787602446.969116:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787602446.969124:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853637120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602446.969183:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853637120:12345-0@lo:400:kworker.0 Request processed in 59us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602446.969191:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787602446.969210:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787602446.969216:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853637248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602446.969243:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853637248:12345-0@lo:400:kworker.0 Request processed in 27us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602446.969249:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1787602446.969282:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602446.969321:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853637248:0@lo:400:kworker.0 00000100:00100000:2.0:1787602446.969331:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853637120:0@lo:400:kworker.0 00000100:00100000:3.0:1787602446.973673:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602446.973706:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853637632:0@lo:400:kworker.0 00000100:00100000:3.0:1787602446.973818:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602446.973873:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853637504:0@lo:400:kworker.0 00000100:00100000:3.0:1787602446.973901:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602446.973941:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853637632 00000100:00100000:3.0:1787602446.973950:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853637632 00000100:00100000:3.0:1787602446.974012:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787602446.974022:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853637632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602446.974083:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853637632:12345-0@lo:400:kworker.0 Request processed in 62us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602446.974090:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787602446.974130:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853637504 00000100:00100000:3.0:1787602446.974134:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853637504 00000100:00100000:3.0:1787602446.974167:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787602446.974174:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853637504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602446.974213:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853637504:12345-0@lo:400:kworker.0 Request processed in 39us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602446.974219:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787602446.974236:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787602446.974241:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787602446.974270:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534975180 x1874436853637632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602446.974286:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853637632:0@lo:400:kworker.0 00000100:00100000:3.0:1787602446.974322:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853637504:0@lo:400:kworker.0 00010000:00010000:3.0:1787602447.026424:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602447.061495:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602447.061569:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602447.061669:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833681920 00000100:00100000:0.0:1787602447.061683:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833681920 00000100:00100000:0.0:1787602447.061806:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:0.0:1787602447.061822:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833681920:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602447.061938:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833681920:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 121us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602447.061947:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:0.0:1787602447.061977:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833681792 00000100:00100000:0.0:1787602447.061982:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833681792 00000100:00100000:0.0:1787602447.062009:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 201 00000100:00100000:0.0:1787602447.062017:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2352:x1874436833681792:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602447.062045:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2352:x1874436833681792:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 29us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602447.062052:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 201 00000100:00080000:3.0:1787602447.062355:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602447.469072:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853637760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602447.469192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602447.469256:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853637760 00000100:00100000:1.0:1787602447.469273:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853637760 00000100:00100000:1.0:1787602447.469583:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787602447.469597:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853637760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602447.469641:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602447.469737:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853637760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602447.470127:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787602447.470725:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534975180 x1874436853637760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602447.470787:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853637760:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787602448.056475:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602449.070261:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602449.518923:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853637888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602449.519053:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602449.519265:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853637888 00000100:00100000:1.0:1787602449.519278:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853637888 00000100:00080000:3.0:1787602449.519473:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602449.519575:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787602449.519591:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853637888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787602449.519964:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602449.520341:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853637888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 750us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602449.520353:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787602449.521230:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d65c380 x1874436853637888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602449.521268:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853637888:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787602450.096551:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602451.119642:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602452.077184:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853638144:0@lo:400:kworker.0 00000100:00100000:3.0:1787602452.077319:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602452.077436:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853638016:0@lo:400:kworker.0 00000100:00100000:1.0:1787602452.077483:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602452.077550:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853638528:0@lo:400:kworker.0 00000100:00100000:1.0:1787602452.077589:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853638016 00000100:00100000:1.0:1787602452.077601:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853638016 00000100:00100000:1.0:1787602452.077668:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787602452.077681:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853638016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602452.077788:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853638016:12345-0@lo:400:kworker.0 Request processed in 109us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602452.077797:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787602452.077990:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853638656:0@lo:400:kworker.0 00000100:00100000:3.0:1787602452.078021:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602452.078048:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787602452.078055:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853638272:0@lo:400:kworker.0 00000100:00100000:3.0:1787602452.078079:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602452.078114:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853638656 00000100:00100000:3.0:1787602452.078118:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853638656 00000100:00100000:3.0:1787602452.078165:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787602452.078173:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853638656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602452.078214:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853638656:12345-0@lo:400:kworker.0 Request processed in 42us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602452.078220:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787602452.078242:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853638144 00000100:00100000:3.0:1787602452.078246:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853638144 00000100:00100000:3.0:1787602452.078284:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853638272 00000100:00100000:3.0:1787602452.078287:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853638272 00000100:00100000:3.0:1787602452.078312:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787602452.078319:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853638144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602452.078437:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853638144:12345-0@lo:400:kworker.0 Request processed in 118us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602452.078444:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787602452.078466:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787602452.078472:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853638272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602452.078504:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853638272:12345-0@lo:400:kworker.0 Request processed in 32us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602452.078510:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1787602452.078529:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787602452.078535:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602452.078583:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853638272:0@lo:400:kworker.0 00000100:00100000:3.0:1787602452.078598:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853638144:0@lo:400:kworker.0 00010000:00080000:3.0:1787602452.078613:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f77b80 x1874436853638656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602452.078623:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853638656:0@lo:400:kworker.0 00000100:00100000:1.0:1787602452.078716:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602452.078781:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853638016:0@lo:400:kworker.0 00000100:00100000:1.0:1787602452.078793:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787602452.078800:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853638400:0@lo:400:kworker.0 00000100:00100000:1.0:1787602452.078827:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602452.078856:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853638400 00000100:00100000:1.0:1787602452.078860:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853638400 00000100:00100000:1.0:1787602452.078907:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787602452.078914:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853638400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602452.078952:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853638400:12345-0@lo:400:kworker.0 Request processed in 39us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602452.078959:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787602452.078978:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787602452.078993:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f76680 x1874436853638400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602452.079004:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853638400:0@lo:400:kworker.0 00000100:00100000:3.0:1787602452.079213:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853638528 00000100:00100000:3.0:1787602452.079217:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853638528 00000100:00100000:3.0:1787602452.079299:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787602452.079308:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853638528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602452.079360:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853638528:12345-0@lo:400:kworker.0 Request processed in 54us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602452.079366:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787602452.081859:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602452.081950:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853638528:0@lo:400:kworker.0 00010000:00010000:0.0:1787602452.141307:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602452.187208:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602452.187601:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602452.187649:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833682048 00000100:00100000:3.0:1787602452.187662:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833682048 00000100:00100000:3.0:1787602452.187834:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 203 00000100:00100000:3.0:1787602452.187848:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2352:x1874436833682048:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602452.188154:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833682176 00000100:00100000:0.0:1787602452.188159:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833682176 00000100:00100000:0.0:1787602452.188231:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:0.0:1787602452.188240:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833682176:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602452.188546:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2352:x1874436833682048:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 700us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602452.188556:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 203 00000100:00100000:0.0:1787602452.188996:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833682176:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 755us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602452.189005:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00080000:0.0:1787602452.189054:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602452.598141:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602452.598185:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853638784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602452.598278:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602452.599892:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853638784 00000100:00100000:3.0:1787602452.599925:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853638784 00000100:00100000:3.0:1787602452.600019:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787602452.600034:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d100000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853638784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602452.600102:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602452.600228:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d100000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853638784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 187us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602452.600239:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787602452.600399:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d100e00 x1874436853638784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602452.600432:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853638784:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787602453.165721:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602454.190016:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602454.638107:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853638912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602454.638218:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602454.638372:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853638912 00000100:00100000:0.0:1787602454.638387:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853638912 00000100:00100000:0.0:1787602454.638482:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787602454.638497:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d100e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853638912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602454.638565:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602454.638631:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d100e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853638912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602454.638639:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787602454.638691:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353557c700 x1874436853638912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602454.638713:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853638912:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787602454.638884:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787602455.216120:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602456.237814:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602457.196999:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853639168:0@lo:400:kworker.0 00000100:00100000:3.0:1787602457.197074:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602457.197131:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853639680:0@lo:400:kworker.0 00000100:00100000:3.0:1787602457.197175:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602457.197207:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787602457.197214:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853639296:0@lo:400:kworker.0 00000100:00100000:2.0:1787602457.197348:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853639424:0@lo:400:kworker.0 00000100:00100000:2.0:1787602457.197391:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602457.197418:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787602457.197423:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853639040:0@lo:400:kworker.0 00000100:00100000:2.0:1787602457.197451:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602457.197471:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874436853639552:0@lo:400:kworker.0 00000100:00100000:2.0:1787602457.197537:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853639680 00000100:00100000:2.0:1787602457.197545:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853639680 00000100:00100000:2.0:1787602457.197594:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853639424 00000100:00100000:2.0:1787602457.197607:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853639424 00000100:00100000:2.0:1787602457.197634:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787602457.197644:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853639680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602457.197697:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853639680:12345-0@lo:400:kworker.0 Request processed in 54us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602457.197704:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787602457.197721:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787602457.197727:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853639424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602457.197784:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853639424:12345-0@lo:400:kworker.0 Request processed in 58us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602457.197791:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787602457.197809:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853639168 00000100:00100000:2.0:1787602457.197813:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853639168 00000100:00100000:2.0:1787602457.197839:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787602457.197846:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853639168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602457.197878:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853639168:12345-0@lo:400:kworker.0 Request processed in 32us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602457.197883:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1787602457.197904:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787602457.197908:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602457.198483:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602457.198605:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853639168:0@lo:400:kworker.0 00010000:00080000:3.0:1787602457.198620:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f76d80 x1874436853639680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602457.198631:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853639680:0@lo:400:kworker.0 00000100:00100000:3.0:1787602457.198669:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787602457.198703:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f75c00 x1874436853639424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602457.198712:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853639424:0@lo:400:kworker.0 00000100:00100000:3.0:1787602457.198739:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853639296 00000100:00100000:3.0:1787602457.198758:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853639296 00000100:00100000:3.0:1787602457.198837:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853639552 00000100:00100000:3.0:1787602457.198841:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853639552 00000100:00100000:3.0:1787602457.198863:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787602457.198870:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853639296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602457.198912:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853639296:12345-0@lo:400:kworker.0 Request processed in 42us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602457.198918:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787602457.198932:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787602457.198938:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874436853639552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602457.198965:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874436853639552:12345-0@lo:400:kworker.0 Request processed in 28us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602457.198970:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1787602457.198985:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602457.199005:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874436853639552:0@lo:400:kworker.0 00000100:00100000:3.0:1787602457.199024:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853639296:0@lo:400:kworker.0 00000100:00100000:1.0:1787602457.199162:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853639040 00000100:00100000:1.0:1787602457.199174:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853639040 00000100:00100000:1.0:1787602457.199211:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787602457.199218:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853639040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602457.199501:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853639040:12345-0@lo:400:kworker.0 Request processed in 283us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602457.199508:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787602457.200873:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853639040:0@lo:400:kworker.0 00010000:00010000:2.0:1787602457.263643:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602457.300507:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602457.300560:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602457.300594:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833682304 00000100:00100000:1.0:1787602457.300604:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833682304 00000100:00100000:2.0:1787602457.300624:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833682432 00000100:00100000:2.0:1787602457.300628:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833682432 00000100:00100000:1.0:1787602457.300663:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 205 00000100:00100000:1.0:1787602457.300672:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2351:x1874436833682304:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602457.300674:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:2.0:1787602457.300680:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2351:x1874436833682432:12345-192.168.201.26@tcp:400:kworker.0 00000100:00080000:3.0:1787602457.300736:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602457.300737:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2351:x1874436833682304:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 66us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602457.300765:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 205 00000100:00100000:2.0:1787602457.305774:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2351:x1874436833682432:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 5079us (5199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602457.305805:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:2.0:1787602457.711610:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853639808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602457.711700:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602457.711846:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853639808 00000100:00100000:0.0:1787602457.711855:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853639808 00000100:00100000:0.0:1787602457.711908:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787602457.711918:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d101180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853639808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787602457.711951:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602457.712341:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d101180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853639808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 422us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602457.712349:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787602457.712414:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f75180 x1874436853639808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602457.712436:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853639808:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787602458.286089:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602459.312576:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602459.756995:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787602459.764375:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853639936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602459.764639:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602459.764784:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853639936 00000100:00100000:0.0:1787602459.764793:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853639936 00000100:00100000:0.0:1787602459.764858:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787602459.764869:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853639936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602459.764907:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602459.764965:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853639936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602459.764973:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787602459.765067:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787602459.765168:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353557c700 x1874436853639936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602459.765189:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853639936:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787602460.333414:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602461.357036:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787602462.016599:0:10118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 16:14:21 (1787602461) === 00000100:00100000:1.0:1787602462.320153:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853640192:0@lo:400:kworker.0 00000100:00100000:1.0:1787602462.320269:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602462.320335:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853640704:0@lo:400:kworker.0 00000100:00100000:1.0:1787602462.320366:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602462.320406:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787602462.320413:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853640320:0@lo:400:kworker.0 00000100:00100000:1.0:1787602462.320450:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602462.320490:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853640704 00000100:00100000:1.0:1787602462.320509:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853640704 00000100:00100000:1.0:1787602462.320582:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787602462.320593:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853640704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602462.320657:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853640704:12345-0@lo:400:kworker.0 Request processed in 65us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602462.320665:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787602462.320696:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853640192 00000100:00100000:1.0:1787602462.320700:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853640192 00000100:00100000:1.0:1787602462.320728:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853640320 00000100:00100000:1.0:1787602462.320731:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853640320 00000100:00100000:1.0:1787602462.320790:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787602462.320798:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853640192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602462.320846:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853640192:12345-0@lo:400:kworker.0 Request processed in 37us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602462.320853:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787602462.320865:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787602462.320871:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853640320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602462.320897:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853640320:12345-0@lo:400:kworker.0 Request processed in 26us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602462.320903:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787602462.320961:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853640320:0@lo:400:kworker.0 00000100:00100000:1.0:1787602462.320973:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853640192:0@lo:400:kworker.0 00010000:00080000:1.0:1787602462.320987:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d65ce00 x1874436853640704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602462.320999:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853640704:0@lo:400:kworker.0 00000100:00100000:3.0:1787602462.321254:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853640064:0@lo:400:kworker.0 00000100:00100000:3.0:1787602462.321296:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602462.321335:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853640576:0@lo:400:kworker.0 00000100:00100000:3.0:1787602462.321357:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602462.321374:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787602462.321380:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853640448:0@lo:400:kworker.0 00000100:00100000:3.0:1787602462.321400:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602462.321442:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853640576 00000100:00100000:3.0:1787602462.321447:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853640576 00000100:00100000:3.0:1787602462.321476:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787602462.321482:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853640576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602462.321515:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853640576:12345-0@lo:400:kworker.0 Request processed in 33us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602462.321522:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787602462.321539:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787602462.321545:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602462.321564:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853640448 00000100:00100000:3.0:1787602462.321568:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853640448 00000100:00100000:3.0:1787602462.321601:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787602462.321607:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853640448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602462.321639:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853640448:12345-0@lo:400:kworker.0 Request processed in 32us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602462.321645:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787602462.321662:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787602462.321680:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d65f800 x1874436853640448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602462.321703:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853640448:0@lo:400:kworker.0 00000100:00100000:3.0:1787602462.321714:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853640576:0@lo:400:kworker.0 00000100:00100000:1.0:1787602462.323617:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853640064 00000100:00100000:1.0:1787602462.323632:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853640064 00000100:00100000:1.0:1787602462.323702:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787602462.323712:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853640064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602462.323824:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853640064:12345-0@lo:400:kworker.0 Request processed in 114us (2526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602462.323893:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787602462.324003:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853640064:0@lo:400:kworker.0 00010000:00010000:3.0:1787602462.382501:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602462.420224:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602462.420285:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602462.420410:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833682560 00000100:00100000:1.0:1787602462.420423:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833682560 00000100:00100000:1.0:1787602462.420497:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 207 00000100:00100000:1.0:1787602462.420511:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2354:x1874436833682560:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602462.420514:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833682688 00000100:00100000:2.0:1787602462.420519:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833682688 00000100:00100000:2.0:1787602462.420577:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00100000:2.0:1787602462.420584:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2354:x1874436833682688:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602462.420609:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2354:x1874436833682560:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 102us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602462.420617:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 207 00000100:00100000:2.0:1787602462.420619:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2354:x1874436833682688:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 36us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602462.420624:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00080000:0.0:1787602462.421339:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602462.454872:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602462.454981:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833682816 00000100:00100000:3.0:1787602462.454995:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833682816 00000100:00100000:3.0:1787602462.455067:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 208 00000100:00100000:3.0:1787602462.455094:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:8127:x1874436833682816:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787602462.455118:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602462.455143:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d353d432a00/0x3640686da09db26c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c22d0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602462.455593:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d432a00/0x3640686da09db26c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22d0 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602462.455607:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d353d432a00/0x3640686da09db26c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22d0 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602462.455619:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432a00, rc 0) 00000100:00100000:3.0:1787602462.455709:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:8127:x1874436833682816:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 630us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602462.455716:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 208 00000100:00100000:3.0:1787602462.459299:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602462.459462:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833682944 00000100:00100000:1.0:1787602462.459477:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833682944 00000100:00100000:1.0:1787602462.459552:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 209 00000100:00100000:1.0:1787602462.459564:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:8127:x1874436833682944:12345-192.168.201.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787602462.460043:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:8127:x1874436833682944:12345-192.168.201.26@tcp:501:mount.lustre.0 Request processed in 479us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602462.460053:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 209 00000100:00100000:0.0:1787602462.470110:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602462.470262:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833683072 00000100:00100000:3.0:1787602462.470277:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833683072 00000100:00100000:3.0:1787602462.470353:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 210 00000100:00100000:3.0:1787602462.470366:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:8127:x1874436833683072:12345-192.168.201.26@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787602462.470692:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:8127:x1874436833683072:12345-192.168.201.26@tcp:503:mount.lustre.0 Request processed in 329us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602462.470702:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 210 00000100:00100000:3.0:1787602462.474390:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602462.475717:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833683200 00000100:00100000:2.0:1787602462.475734:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833683200 00000100:00100000:2.0:1787602462.475852:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 211 00000100:00100000:2.0:1787602462.475864:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:8131:x1874436833683200:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787602462.476289:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:8131:x1874436833683200:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 424us (1911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602462.476298:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 211 00000100:00100000:0.0:1787602462.517940:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602462.518131:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833683328 00000100:00100000:1.0:1787602462.518152:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833683328 00000100:00100000:1.0:1787602462.518223:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 212 00000100:00100000:1.0:1787602462.518236:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:8131:x1874436833683328:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787602462.518618:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:8131:x1874436833683328:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 383us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602462.518629:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 212 00000100:00100000:3.0:1787602462.524573:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602462.525059:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833683456 00000100:00100000:2.0:1787602462.525082:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833683456 00000100:00100000:2.0:1787602462.525203:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 213 00000100:00100000:2.0:1787602462.525218:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:8127:x1874436833683456:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787602462.525243:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602462.525267:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3503702800/0x3640686da09db273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c22fa expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602462.525304:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503702800/0x3640686da09db273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22fa expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602462.525317:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3503702800/0x3640686da09db273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22fa expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602462.525328:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702800, rc 0) 00000100:00100000:2.0:1787602462.526382:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:8127:x1874436833683456:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 1155us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602462.526395:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 213 00000100:00100000:2.0:1787602462.534785:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602462.534884:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833683584 00000100:00100000:3.0:1787602462.534898:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833683584 00000100:00100000:3.0:1787602462.534975:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 214 00000100:00100000:3.0:1787602462.534987:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:8127:x1874436833683584:12345-192.168.201.26@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787602462.535025:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787602462.535086:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787602462.535092:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787602462.535096:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787602462.535098:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787602462.537539:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:8127:x1874436833683584:12345-192.168.201.26@tcp:256:mount.lustre.0 Request processed in 2540us (2757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602462.537557:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 214 00000100:00100000:0.0:1787602462.546004:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602462.546286:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833683712 00000100:00100000:2.0:1787602462.546300:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833683712 00000100:00100000:2.0:1787602462.546372:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 215 00000100:00100000:2.0:1787602462.546384:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:8127:x1874436833683712:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787602462.546407:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602462.546430:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3503702200/0x3640686da09db27a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2301 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602462.546467:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503702200/0x3640686da09db27a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2301 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602462.546502:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3503702200/0x3640686da09db27a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2301 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602462.546514:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702200, rc 0) 00000100:00100000:2.0:1787602462.546587:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:8127:x1874436833683712:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 204us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602462.546595:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 215 00000100:00100000:2.0:1787602462.555553:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602462.558852:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833683840 00000100:00100000:3.0:1787602462.558875:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833683840 00000100:00100000:2.0:1787602462.565718:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 216 00000100:00100000:2.0:1787602462.565739:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:8127:x1874436833683840:12345-192.168.201.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787602462.567575:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:8127:x1874436833683840:12345-192.168.201.26@tcp:501:mount.lustre.0 Request processed in 1828us (12023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602462.567590:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 216 00000100:00100000:1.0:1787602462.570720:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602462.572456:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833683968 00000100:00100000:3.0:1787602462.572475:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833683968 00000100:00100000:3.0:1787602462.572564:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 217 00000100:00100000:3.0:1787602462.572577:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:8127:x1874436833683968:12345-192.168.201.26@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787602462.572972:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:8127:x1874436833683968:12345-192.168.201.26@tcp:503:mount.lustre.0 Request processed in 396us (2270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602462.572982:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 217 00000100:00100000:0.0:1787602462.579645:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602462.579799:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833684096 00000100:00100000:3.0:1787602462.579815:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833684096 00000100:00100000:3.0:1787602462.579890:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 218 00000100:00100000:3.0:1787602462.579903:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:8135:x1874436833684096:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787602462.580480:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:8135:x1874436833684096:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 576us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602462.580490:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 218 00000100:00100000:0.0:1787602462.586664:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602462.586950:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833684224 00000100:00100000:2.0:1787602462.587115:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833684224 00000100:00100000:0.0:1787602462.587379:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 219 00000100:00100000:0.0:1787602462.587393:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:8135:x1874436833684224:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787602462.587776:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:8135:x1874436833684224:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 384us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602462.587787:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 219 00000100:00100000:1.0:1787602462.598831:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602462.598973:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833684352 00000100:00100000:3.0:1787602462.598996:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833684352 00000100:00100000:3.0:1787602462.599062:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:3.0:1787602462.599081:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2350:x1874436833684352:12345-192.168.201.26@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787602462.599126:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 334d0685-d8e1-4308-8cca-e2aac90898dd@192.168.201.26@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:3.0:1787602462.599185:0:5837:0:(genops.c:1385:class_connect()) connect: client 334d0685-d8e1-4308-8cca-e2aac90898dd, cookie 0x3640686da09db281 00000004:00100000:3.0:1787602462.599228:0:5837:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787602462.599546:0:5837:0:(import.c:65:import_set_state_nolock()) ffff8d3503e40000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787602462.599632:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334d0685-d8e1-4308-8cca-e2aac90898dd+6:2350:x1874436833684352:12345-192.168.201.26@tcp:38:mount.lustre.0 Request processed in 559us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602462.599640:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:3.0:1787602462.619849:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602462.621363:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602462.623428:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833684480 00000100:00100000:0.0:1787602462.623451:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833684480 00000100:00100000:0.0:1787602462.623586:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833684608 00000100:00100000:0.0:1787602462.623591:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833684608 00000100:00100000:0.0:1787602462.623623:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:0.0:1787602462.623636:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+7:0:x1874436833684480:12345-192.168.201.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787602462.623699:0:8208:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787602462.623870:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+7:0:x1874436833684480:12345-192.168.201.26@tcp:41:mount.lustre.0 Request processed in 235us (4037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602462.623879:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:0.0:1787602462.623901:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:0.0:1787602462.623910:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+6:8127:x1874436833684608:12345-192.168.201.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787602462.623944:0:8208:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787602462.623968:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+6:8127:x1874436833684608:12345-192.168.201.26@tcp:41:mount.lustre.0 Request processed in 60us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602462.623975:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00080000:3.0:1787602462.625618:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602462.636002:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602462.636367:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833684736 00000100:00100000:3.0:1787602462.636401:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833684736 00000100:00100000:3.0:1787602462.636546:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:3.0:1787602462.636559:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+6:8127:x1874436833684736:12345-192.168.201.26@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787602462.636681:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+6:8127:x1874436833684736:12345-192.168.201.26@tcp:40:mount.lustre.0 Request processed in 124us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602462.636689:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:1.0:1787602462.643445:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602462.643498:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602462.643530:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602462.643661:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833684864 00000100:00100000:2.0:1787602462.643674:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833684864 00000100:00100000:2.0:1787602462.643722:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833684992 00000100:00100000:2.0:1787602462.643724:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833684992 00000100:00100000:2.0:1787602462.643778:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:2.0:1787602462.643788:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1874436833684864:12345-192.168.201.26@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787602462.643833:0:8625:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 334d0685-d8e1-4308-8cca-e2aac90898dd@192.168.201.26@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:2.0:1787602462.643876:0:8625:0:(genops.c:1385:class_connect()) connect: client 334d0685-d8e1-4308-8cca-e2aac90898dd, cookie 0x3640686da09db288 00002000:00100000:2.0:1787602462.643891:0:8625:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 334d0685-d8e1-4308-8cca-e2aac90898dd/ffff8d3405c73000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787602462.643940:0:8625:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787602462.644464:0:8625:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787602462.644570:0:8625:0:(import.c:65:import_set_state_nolock()) ffff8d3405c76800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787602462.644659:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+6:2350:x1874436833684864:12345-192.168.201.26@tcp:8:mount.lustre.0 Request processed in 870us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602462.644668:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:2.0:1787602462.644693:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:2.0:1787602462.644699:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1874436833684992:12345-192.168.201.26@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787602462.644720:0:8625:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 334d0685-d8e1-4308-8cca-e2aac90898dd@192.168.201.26@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:2.0:1787602462.644769:0:8625:0:(genops.c:1385:class_connect()) connect: client 334d0685-d8e1-4308-8cca-e2aac90898dd, cookie 0x3640686da09db28f 00002000:00100000:2.0:1787602462.644778:0:8625:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 334d0685-d8e1-4308-8cca-e2aac90898dd/ffff8d3405c75800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787602462.644798:0:8625:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787602462.644913:0:8625:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787602462.644929:0:8625:0:(import.c:65:import_set_state_nolock()) ffff8d3405c74000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787602462.644950:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+6:2350:x1874436833684992:12345-192.168.201.26@tcp:8:mount.lustre.0 Request processed in 250us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602462.644957:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:3.0:1787602462.645696:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833685120 00000100:00100000:3.0:1787602462.645710:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833685120 00000100:00100000:3.0:1787602462.645791:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:3.0:1787602462.645800:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+6:8127:x1874436833685120:12345-192.168.201.26@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787602462.646171:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787602462.646324:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+6:8127:x1874436833685120:12345-192.168.201.26@tcp:33:mount.lustre.0 Request processed in 524us (2893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602462.646332:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:1.0:1787602462.838015:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853640832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602462.838144:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602462.839480:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853640832 00000100:00100000:3.0:1787602462.839494:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853640832 00000100:00100000:1.0:1787602462.842341:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787602462.842367:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853640832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602462.842404:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602462.842602:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853640832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 246us (4457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602462.842611:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787602462.842686:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f76680 x1874436853640832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602462.842714:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853640832:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787602462.885982:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 334d0685-d8e1-4308-8cca-e2aac90898dd 00010000:00010000:3.0:1787602463.405021:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602464.438313:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602464.885237:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602464.885267:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853640960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602464.885375:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602464.885482:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853640960 00000100:00100000:0.0:1787602464.885493:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853640960 00000100:00100000:0.0:1787602464.885572:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787602464.885585:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853640960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602464.885633:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602464.885688:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853640960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602464.885696:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787602464.885722:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787602464.885783:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353557f800 x1874436853640960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602464.885805:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853640960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787602465.463213:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602466.480966:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787602466.506760:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 334d0685-d8e1-4308-8cca-e2aac90898dd 00000001:00100000:0.0:1787602467.017873:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 334d0685-d8e1-4308-8cca-e2aac90898dd 00000100:00100000:2.0:1787602467.437887:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853641344:0@lo:400:kworker.0 00000100:00100000:2.0:1787602467.437977:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602467.438210:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d102300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853641472:0@lo:400:kworker.0 00000100:00100000:3.0:1787602467.438247:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602467.438280:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787602467.438287:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853641088:0@lo:400:kworker.0 00000100:00100000:3.0:1787602467.438319:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602467.438341:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874436853641600:0@lo:400:kworker.0 00000100:00100000:3.0:1787602467.438365:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602467.438395:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853641088 00000100:00100000:3.0:1787602467.438415:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853641088 00000100:00100000:3.0:1787602467.438457:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787602467.438466:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853641088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602467.438516:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853641088:12345-0@lo:400:kworker.0 Request processed in 50us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602467.438524:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787602467.438565:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853641088:0@lo:400:kworker.0 00000100:00100000:3.0:1787602467.438599:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853641344 00000100:00100000:3.0:1787602467.438603:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853641344 00000100:00100000:3.0:1787602467.438636:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853641600 00000100:00100000:3.0:1787602467.438638:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853641600 00000100:00100000:3.0:1787602467.438655:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787602467.438661:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853641344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602467.438691:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853641344:12345-0@lo:400:kworker.0 Request processed in 30us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602467.438697:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787602467.438707:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787602467.438712:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874436853641600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602467.438738:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874436853641600:12345-0@lo:400:kworker.0 Request processed in 25us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602467.438768:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787602467.438796:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874436853641600:0@lo:400:kworker.0 00000100:00100000:3.0:1787602467.438832:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853641472 00000100:00100000:3.0:1787602467.438836:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853641472 00000100:00100000:3.0:1787602467.438862:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787602467.438868:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853641472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602467.438916:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853641472:12345-0@lo:400:kworker.0 Request processed in 48us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602467.438922:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787602467.438946:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d102300 x1874436853641472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602467.438956:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d102300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853641472:0@lo:400:kworker.0 00000100:00100000:1.0:1787602467.439245:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853641216:0@lo:400:kworker.0 00000100:00100000:1.0:1787602467.439289:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602467.439319:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853641728:0@lo:400:kworker.0 00000100:00100000:1.0:1787602467.439342:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602467.439374:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853641216 00000100:00100000:1.0:1787602467.439378:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853641216 00000100:00100000:1.0:1787602467.439404:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787602467.439411:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853641216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602467.439445:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853641216:12345-0@lo:400:kworker.0 Request processed in 35us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602467.439451:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787602467.439472:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853641728 00000100:00100000:1.0:1787602467.439476:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853641728 00000100:00100000:1.0:1787602467.439497:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787602467.439502:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853641728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602467.439530:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853641728:12345-0@lo:400:kworker.0 Request processed in 28us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602467.439535:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787602467.439560:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853641216:0@lo:400:kworker.0 00010000:00080000:1.0:1787602467.439568:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d100380 x1874436853641728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602467.439576:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853641728:0@lo:400:kworker.0 00000100:00100000:2.0:1787602467.439702:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853641344:0@lo:400:kworker.0 00000100:00080000:0.0:1787602467.439794:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787602467.439798:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787602467.439813:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787602467.501711:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602467.952221:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787602467.952247:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853641856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602467.952323:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602467.952419:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853641856 00000100:00100000:1.0:1787602467.952429:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853641856 00000100:00100000:1.0:1787602467.952495:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787602467.952505:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853641856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602467.952556:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602467.952627:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853641856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602467.952635:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787602467.952679:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534975180 x1874436853641856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602467.952699:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853641856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602468.056960:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602468.057113:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602468.057147:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602468.057181:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602468.057208:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602468.057247:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833685760 00000100:00100000:1.0:1787602468.057260:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833685760 00000100:00100000:1.0:1787602468.057321:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833685632 00000100:00100000:1.0:1787602468.057324:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833685632 00000100:00100000:1.0:1787602468.057345:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:1.0:1787602468.057354:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833685760:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602468.057431:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833685760:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 78us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602468.057439:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:1.0:1787602468.057454:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:1.0:1787602468.057460:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833685632:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602468.057501:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833685632:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 41us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602468.057507:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:1.0:1787602468.057647:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833685504 00000100:00100000:1.0:1787602468.057651:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833685504 00000100:00100000:1.0:1787602468.057678:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833685376 00000100:00100000:1.0:1787602468.057681:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833685376 00000100:00100000:3.0:1787602468.059395:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 69 00000100:00100000:3.0:1787602468.059421:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833685504:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602468.059500:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833685504:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 93us (2387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602468.059508:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 69 00000100:00080000:3.0:1787602468.059561:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787602468.059567:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787602468.059570:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787602468.059947:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 70 00000100:00100000:1.0:1787602468.059957:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2353:x1874436833685376:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602468.060000:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2353:x1874436833685376:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 45us (2817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602468.060007:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 70 00000100:00100000:0.0:1787602468.062714:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833685248 00000100:00100000:0.0:1787602468.062729:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833685248 00000100:00100000:0.0:1787602468.063030:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 221 00000100:00100000:0.0:1787602468.063041:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2353:x1874436833685248:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602468.063392:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2353:x1874436833685248:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 352us (6442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602468.063400:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 221 00010000:00010000:3.0:1787602468.525149:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787602468.959062:0:10314:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787602469.549165:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602469.998512:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853641984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602469.998583:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602469.999590:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853641984 00000100:00100000:0.0:1787602469.999602:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853641984 00000100:00100000:0.0:1787602469.999675:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787602469.999686:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d102d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853641984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602469.999726:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787602469.999832:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602470.005215:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d102d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853641984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5518us (6618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602470.005232:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787602470.007648:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f7d880 x1874436853641984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602470.007694:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853641984:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787602470.577256:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602471.597569:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602472.564057:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853642240:0@lo:400:kworker.0 00000100:00100000:1.0:1787602472.564136:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602472.564214:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853642240 00000100:00100000:1.0:1787602472.564223:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853642240 00000100:00100000:1.0:1787602472.564287:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787602472.564297:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853642240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602472.564367:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853642240:12345-0@lo:400:kworker.0 Request processed in 72us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602472.564390:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787602472.564436:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853642240:0@lo:400:kworker.0 00000100:00100000:1.0:1787602472.564467:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787602472.564488:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853642368:0@lo:400:kworker.0 00000100:00100000:1.0:1787602472.564513:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602472.564543:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853642368 00000100:00100000:1.0:1787602472.564547:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853642368 00000100:00100000:1.0:1787602472.564593:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787602472.564601:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853642368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602472.564636:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853642368:12345-0@lo:400:kworker.0 Request processed in 36us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602472.564642:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1787602472.564670:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602472.564693:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853642368:0@lo:400:kworker.0 00000100:00100000:1.0:1787602472.564734:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853642752:0@lo:400:kworker.0 00000100:00100000:1.0:1787602472.564789:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602472.564823:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853642752 00000100:00100000:1.0:1787602472.564827:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853642752 00000100:00100000:1.0:1787602472.564858:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787602472.564865:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853642752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602472.564910:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853642752:12345-0@lo:400:kworker.0 Request processed in 36us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602472.564917:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787602472.564932:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787602472.564953:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f7df80 x1874436853642752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602472.564964:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853642752:0@lo:400:kworker.0 00000100:00100000:2.0:1787602472.566315:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853642112:0@lo:400:kworker.0 00000100:00100000:2.0:1787602472.566387:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602472.566425:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853642624:0@lo:400:kworker.0 00000100:00100000:2.0:1787602472.566451:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602472.566478:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787602472.566484:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853642496:0@lo:400:kworker.0 00000100:00100000:2.0:1787602472.566511:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602472.566563:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853642624 00000100:00100000:2.0:1787602472.566570:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853642624 00000100:00100000:2.0:1787602472.566620:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787602472.566627:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853642624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602472.566669:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853642624:12345-0@lo:400:kworker.0 Request processed in 43us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602472.566675:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787602472.566695:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853642496 00000100:00100000:2.0:1787602472.566699:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853642496 00000100:00100000:2.0:1787602472.566723:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787602472.566728:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35349f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853642496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602472.566774:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35349f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853642496:12345-0@lo:400:kworker.0 Request processed in 46us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602472.566780:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787602472.566941:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787602472.566946:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787602472.566990:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f7dc00 x1874436853642496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602472.567004:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853642496:0@lo:400:kworker.0 00000100:00100000:2.0:1787602472.567016:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853642624:0@lo:400:kworker.0 00000100:00100000:1.0:1787602472.567549:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853642112 00000100:00100000:1.0:1787602472.567614:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853642112 00000100:00100000:1.0:1787602472.567670:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787602472.567678:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853642112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602472.567727:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853642112:12345-0@lo:400:kworker.0 Request processed in 51us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602472.567734:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787602472.569894:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853642112:0@lo:400:kworker.0 00010000:00010000:1.0:1787602472.624659:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602473.069203:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853642880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602473.069276:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602473.069316:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853642880 00000100:00100000:3.0:1787602473.069325:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853642880 00000100:00100000:3.0:1787602473.069383:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787602473.069391:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787602473.069396:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853642880:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602473.069402:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1787602473.069436:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602473.069501:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853642880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602473.069510:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787602473.069521:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534975c00 x1874436853642880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602473.069544:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853642880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602473.173883:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602473.173987:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602473.174159:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833686272 00000100:00100000:3.0:1787602473.174173:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833686272 00000100:00100000:3.0:1787602473.174283:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:3.0:1787602473.174296:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833686272:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602473.174397:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833686272:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 104us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602473.174406:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:1.0:1787602473.174519:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602473.174812:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602473.174836:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602473.174858:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833686016 00000100:00100000:1.0:1787602473.174863:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833686016 00000100:00100000:1.0:1787602473.174909:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833686144 00000100:00100000:1.0:1787602473.174913:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833686144 00000100:00100000:1.0:1787602473.174938:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 74 00000100:00100000:1.0:1787602473.174945:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2353:x1874436833686016:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602473.175094:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833685888 00000100:00100000:3.0:1787602473.175099:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833685888 00000100:00100000:3.0:1787602473.175128:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 223 00000100:00100000:3.0:1787602473.175135:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2353:x1874436833685888:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602473.175174:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2353:x1874436833685888:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 39us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602473.175181:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 223 00000100:00080000:0.0:1787602473.175466:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787602473.175473:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602473.175505:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 75 00000100:00100000:0.0:1787602473.175515:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833686144:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602473.175548:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833686144:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 36us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602473.175555:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 75 00000100:00100000:0.0:1787602473.175586:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833686400 00000100:00100000:0.0:1787602473.175591:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833686400 00000100:00100000:0.0:1787602473.175637:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:0.0:1787602473.175643:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833686400:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602473.175668:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833686400:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 25us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602473.175690:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:1.0:1787602473.176130:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2353:x1874436833686016:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 1183us (2271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602473.176139:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 74 00000100:00080000:3.0:1787602473.181688:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787602473.647233:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602474.669581:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602475.119025:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602475.119057:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853643008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602475.119180:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602475.119273:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853643008 00000100:00100000:0.0:1787602475.119285:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853643008 00000100:00100000:0.0:1787602475.119374:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787602475.119386:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853643008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602475.119433:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602475.119488:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853643008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602475.119495:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787602475.119520:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787602475.119558:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353557f800 x1874436853643008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602475.119580:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853643008:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787602475.693089:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602476.720474:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602477.687173:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853643520:0@lo:400:kworker.0 00000100:00100000:0.0:1787602477.687299:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602477.687380:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787602477.687387:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853643136:0@lo:400:kworker.0 00000100:00100000:0.0:1787602477.687423:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602477.687449:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874436853643648:0@lo:400:kworker.0 00000100:00100000:0.0:1787602477.687478:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602477.687513:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853643264:0@lo:400:kworker.0 00000100:00100000:0.0:1787602477.687567:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602477.687585:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853643776:0@lo:400:kworker.0 00000100:00100000:0.0:1787602477.687605:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602477.687623:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787602477.687629:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853643392:0@lo:400:kworker.0 00000100:00100000:0.0:1787602477.687650:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602477.687689:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853643520 00000100:00100000:0.0:1787602477.687702:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853643520 00000100:00100000:0.0:1787602477.687795:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853643776 00000100:00100000:0.0:1787602477.687799:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853643776 00000100:00100000:0.0:1787602477.687836:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787602477.687847:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853643520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602477.687926:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853643520:12345-0@lo:400:kworker.0 Request processed in 79us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602477.687933:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787602477.687953:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787602477.687959:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853643776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602477.687991:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853643776:12345-0@lo:400:kworker.0 Request processed in 33us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602477.687997:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787602477.688018:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853643136 00000100:00100000:0.0:1787602477.688022:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853643136 00000100:00100000:0.0:1787602477.688050:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787602477.688058:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853643136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602477.688092:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853643136:12345-0@lo:400:kworker.0 Request processed in 35us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602477.688109:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787602477.688142:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853643648 00000100:00100000:0.0:1787602477.688146:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853643648 00000100:00100000:0.0:1787602477.688174:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853643264 00000100:00100000:0.0:1787602477.688178:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853643264 00000100:00100000:0.0:1787602477.688189:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853643392 00000100:00100000:0.0:1787602477.688191:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853643392 00000100:00100000:0.0:1787602477.688205:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787602477.688211:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874436853643648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602477.688242:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874436853643648:12345-0@lo:400:kworker.0 Request processed in 31us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602477.688247:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787602477.688259:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787602477.688265:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853643264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602477.688295:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853643264:12345-0@lo:400:kworker.0 Request processed in 31us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602477.688300:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787602477.688310:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787602477.688315:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853643392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602477.688338:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853643392:12345-0@lo:400:kworker.0 Request processed in 23us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602477.688344:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1787602477.688373:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787602477.688379:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787602477.688381:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602477.688420:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853643136:0@lo:400:kworker.0 00000100:00100000:0.0:1787602477.688449:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874436853643648:0@lo:400:kworker.0 00010000:00080000:0.0:1787602477.688463:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353557d180 x1874436853643520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602477.688474:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853643520:0@lo:400:kworker.0 00000100:00100000:0.0:1787602477.688516:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853643392:0@lo:400:kworker.0 00000100:00100000:0.0:1787602477.688527:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853643264:0@lo:400:kworker.0 00010000:00080000:0.0:1787602477.688537:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353557ca80 x1874436853643776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602477.688546:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853643776:0@lo:400:kworker.0 00010000:00010000:0.0:1787602477.741295:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602478.194348:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853643904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602478.194448:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602478.195274:0:10486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853643904 00000100:00100000:2.0:1787602478.195289:0:10486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853643904 00000100:00100000:2.0:1787602478.195355:0:10486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787602478.195368:0:10486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853643904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787602478.195414:0:10486:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602478.195485:0:10486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853643904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602478.195494:0:10486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787602478.195563:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f7f480 x1874436853643904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602478.195586:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853643904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602478.296361:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602478.296420:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602478.296506:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833686656 00000100:00100000:2.0:1787602478.296520:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833686656 00000100:00100000:2.0:1787602478.296618:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 79 00000100:00100000:2.0:1787602478.296633:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833686656:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602478.296739:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833686656:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 111us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602478.296767:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 79 00000100:00100000:0.0:1787602478.297382:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602478.297418:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602478.297445:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602478.297500:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833686528 00000100:00100000:2.0:1787602478.297507:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833686528 00000100:00100000:2.0:1787602478.297546:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 225 00000100:00100000:2.0:1787602478.297554:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2352:x1874436833686528:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602478.297600:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2352:x1874436833686528:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 46us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602478.297607:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 225 00000100:00080000:1.0:1787602478.297704:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602478.304670:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833686784 00000100:00100000:1.0:1787602478.304689:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833686784 00000100:00100000:1.0:1787602478.304814:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 80 00000100:00100000:1.0:1787602478.304829:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833686784:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602478.304959:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833686784:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 133us (7539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602478.304967:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 80 00000100:00080000:1.0:1787602478.305001:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602478.311110:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833686912 00000100:00100000:3.0:1787602478.311131:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833686912 00000100:00100000:1.0:1787602478.313920:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833687040 00000100:00100000:1.0:1787602478.313945:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833687040 00000100:00100000:1.0:1787602478.314071:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:1.0:1787602478.314081:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833687040:12345-192.168.201.26@tcp:400:kworker.0 00000100:00080000:0.0:1787602478.314441:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787602478.322548:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:2.0:1787602478.322566:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833686912:12345-192.168.201.26@tcp:400:kworker.0 00000100:00080000:0.0:1787602478.325948:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602478.326260:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833687040:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 12170us (28804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602478.326274:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:2.0:1787602478.326686:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833686912:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 4122us (30263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602478.326693:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 48 00010000:00010000:1.0:1787602478.765331:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602479.789462:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602480.237145:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602480.237179:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853644032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602480.237277:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602480.237379:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853644032 00000100:00100000:0.0:1787602480.237389:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853644032 00000100:00100000:0.0:1787602480.237461:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787602480.237475:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853644032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602480.237545:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602480.237599:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853644032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602480.237607:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787602480.237633:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787602480.237669:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353557dc00 x1874436853644032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602480.237691:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853644032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787602480.812989:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602481.837009:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602482.798897:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602482.798922:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853644160:0@lo:400:kworker.0 00000100:00100000:3.0:1787602482.798997:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602482.799079:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853644160 00000100:00100000:3.0:1787602482.799086:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853644160 00000100:00100000:3.0:1787602482.799132:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787602482.799141:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853644160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602482.799202:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853644160:12345-0@lo:400:kworker.0 Request processed in 60us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602482.799222:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787602482.799275:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853644160:0@lo:400:kworker.0 00000100:00100000:2.0:1787602482.799648:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853644288:0@lo:400:kworker.0 00000100:00100000:2.0:1787602482.799681:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602482.799703:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853644800:0@lo:400:kworker.0 00000100:00100000:2.0:1787602482.799762:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602482.799783:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602482.799868:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853644416:0@lo:400:kworker.0 00000100:00100000:2.0:1787602482.799897:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602482.799946:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853644288 00000100:00100000:2.0:1787602482.799951:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853644288 00000100:00100000:2.0:1787602482.799985:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853644416 00000100:00100000:2.0:1787602482.799989:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853644416 00000100:00100000:2.0:1787602482.800018:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787602482.800025:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853644288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602482.800192:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d102300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853644672:0@lo:400:kworker.0 00000100:00100000:0.0:1787602482.800225:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602482.800240:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602482.800245:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853644544:0@lo:400:kworker.0 00000100:00100000:0.0:1787602482.800265:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602482.800382:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853644288:12345-0@lo:400:kworker.0 Request processed in 357us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602482.800391:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787602482.800405:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853644672 00000100:00100000:2.0:1787602482.800409:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853644672 00000100:00100000:2.0:1787602482.800427:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787602482.800434:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853644416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602482.800464:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853644416:12345-0@lo:400:kworker.0 Request processed in 31us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602482.800470:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787602482.800482:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787602482.800488:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853644672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602482.800519:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853644672:12345-0@lo:400:kworker.0 Request processed in 31us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602482.800525:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1787602482.800547:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602482.800759:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853644416:0@lo:400:kworker.0 00000100:00100000:0.0:1787602482.800774:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853644288:0@lo:400:kworker.0 00000100:00100000:2.0:1787602482.800919:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d102300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853644672:0@lo:400:kworker.0 00000100:00100000:2.0:1787602482.800993:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853644800 00000100:00100000:2.0:1787602482.800997:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853644800 00000100:00100000:3.0:1787602482.801184:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853644544 00000100:00100000:3.0:1787602482.801189:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853644544 00000100:00100000:3.0:1787602482.801226:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787602482.801235:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853644800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602482.801283:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853644800:12345-0@lo:400:kworker.0 Request processed in 50us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602482.801289:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787602482.801301:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787602482.801307:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853644544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602482.801339:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853644544:12345-0@lo:400:kworker.0 Request processed in 32us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602482.801345:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1787602482.801372:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d101f80 x1874436853644800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602482.801384:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853644800:0@lo:400:kworker.0 00010000:00080000:3.0:1787602482.801409:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d100a80 x1874436853644544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602482.801418:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853644544:0@lo:400:kworker.0 00000100:00080000:0.0:1787602482.801690:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787602482.801694:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787602482.864043:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602483.310459:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853644928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602483.310543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602483.310796:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853644928 00000100:00100000:3.0:1787602483.310805:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853644928 00000100:00100000:3.0:1787602483.310862:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787602483.310873:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853644928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602483.310924:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602483.310990:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853644928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602483.310999:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787602483.311038:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534976d80 x1874436853644928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602483.311184:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853644928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602483.414561:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602483.414608:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602483.414812:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602483.414848:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602483.414877:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602483.414909:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833687296 00000100:00100000:2.0:1787602483.414919:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833687296 00000100:00100000:2.0:1787602483.415291:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833687424 00000100:00100000:2.0:1787602483.415297:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833687424 00000100:00100000:2.0:1787602483.415324:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 84 00000100:00100000:2.0:1787602483.415335:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2354:x1874436833687296:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602483.415414:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2354:x1874436833687296:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 80us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602483.415421:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 84 00000100:00100000:2.0:1787602483.415440:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 85 00000100:00100000:2.0:1787602483.415447:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2354:x1874436833687424:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602483.415546:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2354:x1874436833687424:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 98us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602483.415554:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 85 00000100:00100000:2.0:1787602483.415578:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833687168 00000100:00100000:2.0:1787602483.415581:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833687168 00000100:00100000:2.0:1787602483.415607:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 227 00000100:00100000:2.0:1787602483.415614:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833687168:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602483.415706:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833687168:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 91us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602483.415738:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 227 00000100:00080000:2.0:1787602483.415795:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602483.416032:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833687552 00000100:00100000:1.0:1787602483.416044:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833687552 00000100:00100000:1.0:1787602483.416094:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833687680 00000100:00100000:1.0:1787602483.416098:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833687680 00000100:00100000:1.0:1787602483.416120:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:1.0:1787602483.416127:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2350:x1874436833687552:12345-192.168.201.26@tcp:9:kworker.0 00000020:00000080:1.0:1787602483.416149:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db288 00000100:00080000:1.0:1787602483.416160:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8d3405c76800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787602483.416196:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787602483.416514:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+2:2350:x1874436833687552:12345-192.168.201.26@tcp:9:kworker.0 Request processed in 387us (1964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602483.416521:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:1.0:1787602483.416536:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:1.0:1787602483.416553:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2350:x1874436833687680:12345-192.168.201.26@tcp:9:kworker.0 00000020:00000080:1.0:1787602483.416565:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db28f 00000100:00080000:1.0:1787602483.416571:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8d3405c74000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787602483.416592:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787602483.416836:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+2:2350:x1874436833687680:12345-192.168.201.26@tcp:9:kworker.0 Request processed in 284us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602483.416843:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 15 00010000:00010000:1.0:1787602483.416869:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602483.416907:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787602483.416913:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602483.416917:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787602483.887686:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602484.909900:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602485.367413:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787602485.367439:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853645056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602485.367516:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602485.367648:0:10486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853645056 00000100:00100000:1.0:1787602485.367655:0:10486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853645056 00000100:00100000:1.0:1787602485.367726:0:10486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787602485.367735:0:10486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853645056:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787602485.367882:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787602485.367954:0:10486:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602485.368018:0:10486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853645056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 284us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602485.368025:0:10486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1787602485.368098:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f7e680 x1874436853645056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602485.368121:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853645056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787602485.932920:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602486.960029:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787602487.138305:0:11016:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1787602487.527118:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 334d0685-d8e1-4308-8cca-e2aac90898dd 00000020:00000080:1.0:1787602487.527129:0:7646:0:(genops.c:885:class_export_put()) final put ffff8d3405c75800/334d0685-d8e1-4308-8cca-e2aac90898dd 00000020:00000080:2.0:1787602487.527212:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3405c75800/334d0685-d8e1-4308-8cca-e2aac90898dd for lustre-OST0001 00000020:00000080:2.0:1787602487.527266:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3405c74000 for lustre-OST0001 00000100:00100000:0.0:1787602487.921533:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853645312:0@lo:400:kworker.0 00000100:00100000:0.0:1787602487.921651:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602487.921820:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d102300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853645568:0@lo:400:kworker.0 00000100:00100000:1.0:1787602487.921860:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602487.921924:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853645568 00000100:00100000:1.0:1787602487.921934:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853645568 00000100:00100000:1.0:1787602487.922029:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787602487.922040:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853645568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602487.922105:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853645568:12345-0@lo:400:kworker.0 Request processed in 66us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602487.922114:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1787602487.922142:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602487.922184:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853645440:0@lo:400:kworker.0 00000100:00100000:1.0:1787602487.922459:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602487.922496:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853645312 00000100:00100000:1.0:1787602487.922501:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853645312 00000100:00100000:1.0:1787602487.922534:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853645440 00000100:00100000:1.0:1787602487.922537:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853645440 00000100:00100000:1.0:1787602487.922564:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787602487.922571:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853645312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602487.922611:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853645312:12345-0@lo:400:kworker.0 Request processed in 40us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602487.922618:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787602487.922631:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787602487.922648:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853645440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602487.922680:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853645440:12345-0@lo:400:kworker.0 Request processed in 44us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602487.922686:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1787602487.922723:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602487.923123:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853645184:0@lo:400:kworker.0 00000100:00100000:3.0:1787602487.923172:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602487.923342:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853645312:0@lo:400:kworker.0 00000100:00100000:0.0:1787602487.923354:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853645824:0@lo:400:kworker.0 00000100:00100000:0.0:1787602487.923387:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787602487.923563:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d102300 x1874436853645568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602487.923577:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d102300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853645568:0@lo:400:kworker.0 00000100:00100000:1.0:1787602487.923663:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853645184 00000100:00100000:1.0:1787602487.923668:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853645184 00000100:00100000:1.0:1787602487.923716:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787602487.923730:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853645184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602487.923806:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853645184:12345-0@lo:400:kworker.0 Request processed in 77us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602487.923813:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787602487.923845:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853645824 00000100:00100000:1.0:1787602487.923848:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853645824 00000100:00100000:1.0:1787602487.923883:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787602487.923889:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853645824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602487.923922:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853645824:12345-0@lo:400:kworker.0 Request processed in 33us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602487.923928:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787602487.923947:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787602487.924242:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853645184:0@lo:400:kworker.0 00000100:00100000:1.0:1787602487.924257:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853645696:0@lo:400:kworker.0 00000100:00100000:1.0:1787602487.924289:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787602487.924345:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d100380 x1874436853645824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602487.924357:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853645824:0@lo:400:kworker.0 00000100:00100000:3.0:1787602487.924420:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853645696 00000100:00100000:3.0:1787602487.924425:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853645696 00000100:00100000:3.0:1787602487.924464:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787602487.924469:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853645696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602487.924505:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853645696:12345-0@lo:400:kworker.0 Request processed in 35us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602487.924511:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1787602487.924571:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602487.924589:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853645696:0@lo:400:kworker.0 00000100:00100000:0.0:1787602487.924815:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853645440:0@lo:400:kworker.0 00010000:00010000:1.0:1787602487.983534:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602488.430448:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787602488.430486:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853645952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602488.430585:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602488.430697:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853645952 00000100:00100000:1.0:1787602488.430727:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853645952 00000100:00100000:1.0:1787602488.430818:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787602488.430829:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853645952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602488.430884:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602488.430940:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853645952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602488.430949:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787602488.432269:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534976d80 x1874436853645952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602488.432302:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853645952:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787602488.500240:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 334d0685-d8e1-4308-8cca-e2aac90898dd 00000020:00000080:1.0:1787602488.500253:0:6714:0:(genops.c:885:class_export_put()) final put ffff8d3405c73000/334d0685-d8e1-4308-8cca-e2aac90898dd 00000020:00000080:1.0:1787602488.500286:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3405c73000/334d0685-d8e1-4308-8cca-e2aac90898dd for lustre-OST0000 00000020:00000080:1.0:1787602488.500346:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3405c76800 for lustre-OST0000 00000100:00100000:0.0:1787602488.533169:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602488.533226:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602488.533264:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602488.533405:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833687808 00000100:00100000:3.0:1787602488.533419:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833687808 00000100:00100000:1.0:1787602488.533486:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833688064 00000100:00100000:3.0:1787602488.533490:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 229 00000100:00100000:1.0:1787602488.533491:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833688064 00000100:00100000:3.0:1787602488.533502:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833687808:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602488.533553:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833687936 00000100:00100000:1.0:1787602488.533557:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833687936 00000100:00100000:1.0:1787602488.533580:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 89 00000100:00100000:1.0:1787602488.533588:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2354:x1874436833688064:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602488.533599:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833687808:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 99us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602488.533620:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 229 00000100:00100000:1.0:1787602488.533624:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2354:x1874436833688064:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 38us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602488.533641:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 89 00000100:00100000:1.0:1787602488.533654:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 90 00000100:00100000:1.0:1787602488.533660:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2354:x1874436833687936:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602488.533685:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2354:x1874436833687936:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 25us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602488.533699:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 90 00000100:00080000:1.0:1787602488.533722:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787602489.007535:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602490.028844:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602490.477160:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853646080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602490.477265:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602490.490791:0:10486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853646080 00000100:00100000:1.0:1787602490.490809:0:10486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853646080 00000100:00080000:1.0:1787602490.490901:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602490.490950:0:10486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787602490.490964:0:10486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853646080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602490.491011:0:10486:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602490.491114:0:10486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853646080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (13850us total) trans 0 rc 0/0 00010000:00080000:0.0:1787602490.491213:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f7e680 x1874436853646080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602490.491248:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853646080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602490.502272:0:10486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000020:00000080:0.0:1787602490.904141:0:11165:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd088fd740 20000000:00000080:0.0:1787602490.904173:0:11165:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d3406146400 uarg=0000000000000000 20000000:01000000:0.0:1787602490.904224:0:11165:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787602490.904233:0:11165:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787602490.904240:0:11165:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787602490.917222:0:11166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1787602490.919723:0:11165:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787602490.934774:0:11165:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787602490.934938:0:11165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3528f20200/0x3640686da09db296 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.934964:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3500030000/0x3640686da09db23b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22c9 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.934973:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d353d432e00/0x3640686da09db249 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db242 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.934978:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3500030400/0x3640686da09db257 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db250 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.934982:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3503703e00/0x3640686da09db265 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db25e expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.934986:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3503702200/0x3640686da09db27a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2301 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.934991:0:11165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3528f20200/0x3640686da09db296 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935053:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3503702200/0x3640686da09db27a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2301 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935112:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3503702200/0x3640686da09db27a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2301 expref: 12 pid: 5832 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602490.935129:0:11165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1874436853646208:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602490.935271:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3503703e00/0x3640686da09db265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db25e expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935278:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3503703e00/0x3640686da09db265 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db25e expref: 18 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602490.935286:0:11165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1874436853646336:0@lo:104: 00000100:00100000:1.0:1787602490.935338:0:11165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787602490.935379:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3500030400/0x3640686da09db257 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db250 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935385:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3500030400/0x3640686da09db257 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db250 expref: 18 pid: 5831 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602490.935390:0:11165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1874436853646464:0@lo:104: 00000100:00100000:1.0:1787602490.935404:0:11165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602490.935437:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853646336 00000100:00100000:1.0:1787602490.935444:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853646336 00000100:00100000:1.0:1787602490.935493:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853646464 00000100:00100000:1.0:1787602490.935494:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853646464 00000100:00100000:1.0:1787602490.935505:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787602490.935514:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+4:11165:x1874436853646336:12345-0@lo:104: 00010000:00010000:1.0:1787602490.935526:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db25e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db265 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935577:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602490.935581:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+4:11165:x1874436853646336:12345-0@lo:104: Request processed in 68us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602490.935600:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787602490.935622:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787602490.935633:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:11165:x1874436853646464:12345-0@lo:104: 00010000:00010000:1.0:1787602490.935641:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db257 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935672:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787602490.935677:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:11165:x1874436853646464:12345-0@lo:104: Request processed in 49us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602490.935683:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1787602490.935702:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787602490.935709:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db25e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db265 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935717:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3500031a00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602490.935722:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db25e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db265 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935732:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db25e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db265 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602490.935740:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db25e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db265 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602490.935765:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787602490.935807:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db25e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db265 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935814:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602490.935837:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db25e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db265 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935844:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db25e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db265 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935860:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602490.935863:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db257 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935869:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3500031000 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602490.935872:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db250 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db257 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935880:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db257 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602490.935886:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db250 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db257 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602490.935892:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787602490.935904:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db250 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db257 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.935910:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787602490.935966:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853646720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602490.936013:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787602490.936150:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db250 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db257 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.936170:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db250 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db257 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.936179:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602490.936181:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602490.936183:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602490.936192:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602490.936222:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d353d432e00/0x3640686da09db249 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db242 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.936233:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d353d432e00/0x3640686da09db249 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db242 expref: 18 pid: 5829 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602490.936241:0:11165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1874436853646848:0@lo:104: 00000100:00100000:1.0:1787602490.936287:0:11165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602490.936316:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853646848 00000100:00100000:1.0:1787602490.936322:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853646848 00000100:00100000:1.0:1787602490.936350:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787602490.936357:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d219c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:11165:x1874436853646848:12345-0@lo:104: 00010000:00010000:1.0:1787602490.936366:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3528f21000/0x3640686da09db242 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db249 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.936403:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602490.936408:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d219c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:11165:x1874436853646848:12345-0@lo:104: Request processed in 52us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602490.936427:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787602490.936444:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602490.936449:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3528f21000/0x3640686da09db242 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db249 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.936467:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3528f21000 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602490.936471:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f21000/0x3640686da09db242 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db249 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.936478:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3528f21000/0x3640686da09db242 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db249 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602490.936484:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f21000/0x3640686da09db242 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db249 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602490.936490:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787602490.936506:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3528f21000/0x3640686da09db242 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db249 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.936512:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787602490.936779:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853646720 00000100:00100000:2.0:1787602490.936785:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853646720 00010000:00010000:2.0:1787602490.936814:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3500030400/0x3640686da09db257 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db250 expref: 19 pid: 5831 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.936844:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787602490.936852:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3509d57850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853646720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787602490.936876:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602490.936883:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3500030400/0x3640686da09db257 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db250 expref: 19 pid: 5831 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.936896:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3500030400/0x3640686da09db257 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db250 expref: 19 pid: 5831 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.936920:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602490.937212:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853646592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602490.937253:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602490.937312:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853646976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602490.937340:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602490.937369:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787602490.937380:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787602490.938732:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3528f21000/0x3640686da09db242 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db249 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.938758:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3528f21000/0x3640686da09db242 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db249 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.938782:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602490.938786:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602490.938789:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602490.939200:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3509d57850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853646720:12345-0@lo:103:ldlm_bl.0 Request processed in 2344us (3181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602490.939214:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1787602490.939227:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3500030000/0x3640686da09db23b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22c9 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.939251:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3500030000/0x3640686da09db23b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22c9 expref: 12 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602490.939270:0:11165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1874436853647104:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602490.939282:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853646592 00000100:00100000:2.0:1787602490.939302:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853646592 00010000:00010000:2.0:1787602490.939337:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3503703e00/0x3640686da09db265 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db25e expref: 19 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.939354:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853646976 00000100:00100000:2.0:1787602490.939357:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853646976 00010000:00010000:2.0:1787602490.939367:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d353d432e00/0x3640686da09db249 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db242 expref: 20 pid: 5829 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.939380:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787602490.939388:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+20:3302:x1874436853646592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787602490.939402:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602490.939407:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3503703e00/0x3640686da09db265 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db25e expref: 20 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.939421:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3503703e00/0x3640686da09db265 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db25e expref: 20 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.939457:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602490.939526:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+20:3302:x1874436853646592:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602490.939533:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787602490.939544:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787602490.939550:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3304:x1874436853646976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787602490.939557:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602490.939561:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d353d432e00/0x3640686da09db249 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db242 expref: 19 pid: 5829 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.939570:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d353d432e00/0x3640686da09db249 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db242 expref: 19 pid: 5829 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.939579:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602490.939620:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3304:x1874436853646976:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602490.939626:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787602490.939670:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853646976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602490.940061:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853646592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787602490.940313:0:11165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b9483c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787602490.940332:0:11165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3503703e00/0x3640686da09db265 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db25e expref: 18 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602490.940347:0:11165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1874436853646336:0@lo:104: 00010000:00010000:1.0:1787602490.940373:0:11165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3500030400/0x3640686da09db257 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db250 expref: 17 pid: 5831 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602490.940384:0:11165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1874436853646464:0@lo:104: 00010000:00010000:1.0:1787602490.940395:0:11165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d353d432e00/0x3640686da09db249 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db242 expref: 16 pid: 5829 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602490.940403:0:11165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1874436853646848:0@lo:104: 00000100:00100000:3.0:1787602490.941494:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853646720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787602490.951656:0:11165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1874436853646208:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602490.951683:0:11165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1874436853647104:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602490.951779:0:11165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3528f20200/0x3640686da09db296 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602490.952871:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602490.953061:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833688192 00000100:00100000:2.0:1787602490.953071:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833688192 00010000:00010000:2.0:1787602490.953133:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3503702200/0x3640686da09db27a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2301 expref: 13 pid: 5832 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602490.953184:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00100000:2.0:1787602490.953196:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2352:x1874436833688192:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602490.953216:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602490.953243:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3503702200/0x3640686da09db27a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2301 expref: 13 pid: 5832 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.953259:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3503702200/0x3640686da09db27a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2301 expref: 13 pid: 5832 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.953284:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3503702200/0x3640686da09db27a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2301 expref: 13 pid: 5832 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602490.953315:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602490.953390:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:2352:x1874436833688192:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 196us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602490.953399:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00100000:2.0:1787602490.960496:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602490.960664:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833688320 00000100:00100000:0.0:1787602490.960680:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833688320 00010000:00010000:0.0:1787602490.960777:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3500030000/0x3640686da09db23b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22c9 expref: 12 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602490.960834:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 29 00000100:00100000:0.0:1787602490.960850:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:2351:x1874436833688320:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602490.960873:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602490.960880:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3500030000/0x3640686da09db23b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22c9 expref: 12 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.960897:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3500030000/0x3640686da09db23b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22c9 expref: 12 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.960920:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3500030000/0x3640686da09db23b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22c9 expref: 12 pid: 5831 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.960944:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3528f20200/0x3640686da09db296 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.960953:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3528f20200/0x3640686da09db296 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.960974:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3528f20200/0x3640686da09db296 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.960981:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3528f20200/0x3640686da09db296 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.961007:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3528f20200/0x3640686da09db296 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.961015:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3528f20200/0x3640686da09db296 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.961022:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3528f20200 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602490.961028:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3528f20200/0x3640686da09db296 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.961037:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3528f20200/0x3640686da09db296 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.961050:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3528f20200/0x3640686da09db296 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602490.961063:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602490.961143:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:2351:x1874436833688320:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 296us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602490.961152:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 29 00010000:00010000:1.0:1787602490.961639:0:11165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3528f20200/0x3640686da09db296 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.961661:0:11165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3528f20200/0x3640686da09db296 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602490.961670:0:11165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3528f20200/0x3640686da09db296 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602491.053850:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602492.081798:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787602492.081994:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787602492.081999:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d35271fb800 from 7 10000000:01000000:0.0:1787602492.082004:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602492.082060:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db29d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.082071:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db29d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.082085:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db29d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602492.082128:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853647232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602492.082219:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602492.082279:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350c8b9480 going to sleep for 11 seconds 00000100:00100000:3.0:1787602492.082415:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853647232 00000100:00100000:3.0:1787602492.082424:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853647232 00000100:00100000:3.0:1787602492.082483:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787602492.082493:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853647232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602492.082507:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602492.082523:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d353d433c00/0x3640686da09db2a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db29d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602492.082547:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d433c00/0x3640686da09db2a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db29d expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602492.082558:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d353d433c00/0x3640686da09db2a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db29d expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602492.082605:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433c00, rc 0) 00000100:00100000:3.0:1787602492.082661:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853647232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602492.082668:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787602492.083041:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853647232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602492.083058:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db29d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db2a4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602492.083067:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db29d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db2a4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602492.083129:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853647360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602492.083161:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602492.083196:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3539774540 going to sleep for 11 seconds 00000100:00100000:0.0:1787602492.083238:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853647360 00000100:00100000:0.0:1787602492.083243:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853647360 00000100:00100000:0.0:1787602492.083277:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787602492.083285:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853647360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602492.083581:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853647360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602492.083589:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787602492.083715:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853647360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602492.083783:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853647488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602492.083982:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602492.084007:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3539774540 going to sleep for 11 seconds 00000100:00100000:3.0:1787602492.084095:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853647488 00000100:00100000:3.0:1787602492.084101:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853647488 00000100:00100000:3.0:1787602492.084130:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787602492.084138:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853647488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602492.084426:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853647488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 289us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602492.084433:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787602492.084719:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853647488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787602492.086399:0:11186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787602492.086624:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787602492.086647:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602492.086661:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db29d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db2a4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.086673:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db29d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db2a4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602492.086686:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787602492.086689:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d353d79c800 from 7 10000000:01000000:0.0:1787602492.086692:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602492.086735:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db2ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.086901:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db2ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.086917:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db2ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602492.086966:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853647616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602492.087039:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602492.087142:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350c8b9180 going to sleep for 11 seconds 00000100:00100000:1.0:1787602492.092513:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853647616 00000100:00100000:1.0:1787602492.092531:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853647616 00000100:00100000:2.0:1787602492.093895:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787602492.093916:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853647616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602492.093937:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602492.093962:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3503702a00/0x3640686da09db2b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db2ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602492.093994:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503702a00/0x3640686da09db2b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db2ab expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602492.094005:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3503702a00/0x3640686da09db2b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db2ab expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602492.094013:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702a00, rc 0) 00000100:00100000:2.0:1787602492.094106:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853647616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (7066us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602492.094112:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787602492.094220:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853647616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602492.094241:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db2ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db2b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602492.094270:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db2ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db2b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602492.094356:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d21ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853647744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602492.094394:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602492.096942:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787602492.102148:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853647744 00000100:00100000:0.0:1787602492.102167:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853647744 00000100:00100000:0.0:1787602492.102244:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787602492.102255:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853647744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602492.102685:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853647744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 431us (8289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602492.102695:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787602492.102813:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d21ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853647744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602492.102891:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853647872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602492.102939:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602492.102969:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350c8b9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602492.102982:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853647872 00000100:00100000:0.0:1787602492.102986:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853647872 00000100:00100000:0.0:1787602492.103004:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787602492.103010:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853647872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602492.103156:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853647872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602492.103163:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787602492.103192:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853647872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787602492.103916:0:11187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787602492.103994:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787602492.104024:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602492.104036:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db2ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db2b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.104046:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db2ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db2b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602492.104056:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787602492.104058:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3509288800 from 7 10000000:01000000:0.0:1787602492.104061:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602492.104091:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09db2b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.104098:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09db2b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.104108:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09db2b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602492.104126:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853648000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602492.104162:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602492.104182:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350c8b9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787602492.104197:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853648000 00000100:00100000:0.0:1787602492.104202:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853648000 00000100:00100000:0.0:1787602492.104228:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787602492.104237:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853648000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602492.104248:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602492.104261:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3500030800/0x3640686da09db2c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db2b9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.104296:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3500030800/0x3640686da09db2c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db2b9 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.104306:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3500030800/0x3640686da09db2c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db2b9 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.104315:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3500030800, rc 0) 00000100:00100000:0.0:1787602492.104347:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853648000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602492.104353:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787602492.104402:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853648000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602492.104419:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09db2b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db2c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.104428:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09db2b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db2c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602492.104479:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853648128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602492.104511:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602492.104527:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350c8b9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787602492.104540:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853648128 00000100:00100000:0.0:1787602492.104543:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853648128 00000100:00100000:0.0:1787602492.104561:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787602492.104582:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853648128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602492.104911:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853648128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602492.104930:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787602492.104961:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853648128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602492.104987:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853648256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602492.105025:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602492.105040:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350c8b9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787602492.105051:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853648256 00000100:00100000:0.0:1787602492.105054:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853648256 00000100:00100000:0.0:1787602492.105080:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787602492.105087:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853648256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602492.105252:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853648256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602492.105260:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787602492.105303:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853648256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787602492.119384:0:11188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787602492.119683:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787602492.119711:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602492.119723:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09db2b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db2c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.119736:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09db2b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db2c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602492.314713:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602492.315127:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833688448 00000100:00100000:0.0:1787602492.315140:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833688448 00000100:00100000:0.0:1787602492.315233:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 239 00000100:00100000:0.0:1787602492.315249:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:5593:x1874436833688448:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602492.315286:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602492.315326:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3500030000/0x3640686da09db2c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c232b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.315363:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3500030000/0x3640686da09db2c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c232b expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.315375:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3500030000/0x3640686da09db2c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c232b expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.315387:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3500030000, rc 0) 00000100:00100000:0.0:1787602492.315465:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:5593:x1874436833688448:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 Request processed in 219us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602492.315473:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 239 00000100:00100000:1.0:1787602492.324819:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602492.324893:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833688576 00000100:00100000:1.0:1787602492.324906:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833688576 00000100:00100000:1.0:1787602492.324979:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 240 00000100:00100000:1.0:1787602492.324993:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:5593:x1874436833688576:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602492.325454:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:5593:x1874436833688576:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 Request processed in 460us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602492.325466:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 240 00000100:00100000:0.0:1787602492.338727:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602492.338826:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833688704 00000100:00100000:1.0:1787602492.338854:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833688704 00000100:00100000:1.0:1787602492.338934:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 241 00000100:00100000:1.0:1787602492.338947:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:5593:x1874436833688704:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602492.351238:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:5593:x1874436833688704:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 Request processed in 12271us (12500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602492.351261:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 241 00000100:00100000:2.0:1787602492.363993:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602492.372764:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833688832 00000100:00100000:0.0:1787602492.372789:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833688832 00000100:00100000:0.0:1787602492.372884:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 242 00000100:00100000:0.0:1787602492.372896:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:5593:x1874436833688832:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602492.372916:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602492.372939:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3500030400/0x3640686da09db2ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2332 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.372975:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3500030400/0x3640686da09db2ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2332 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.372987:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3500030400/0x3640686da09db2ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2332 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602492.373019:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3500030400, rc 0) 00000100:00100000:0.0:1787602492.373101:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:5593:x1874436833688832:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 Request processed in 207us (9127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602492.373108:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 242 00000100:00100000:1.0:1787602492.380946:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602492.381036:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833688960 00000100:00100000:2.0:1787602492.381052:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833688960 00000100:00100000:2.0:1787602492.381133:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 243 00000100:00100000:2.0:1787602492.381149:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:5593:x1874436833688960:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602492.383390:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:5593:x1874436833688960:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 Request processed in 2223us (2433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602492.383415:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 243 00000100:00100000:2.0:1787602492.399959:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602492.400412:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833689088 00000100:00100000:3.0:1787602492.400424:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833689088 00000100:00100000:3.0:1787602492.400495:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 244 00000100:00100000:3.0:1787602492.400506:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:5593:x1874436833689088:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602492.400822:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:5593:x1874436833689088:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 Request processed in 317us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602492.400909:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 244 00000100:00100000:2.0:1787602493.041045:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853648768:0@lo:400:kworker.0 00000100:00100000:2.0:1787602493.041130:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602493.041192:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787602493.041198:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853648640:0@lo:400:kworker.0 00000100:00100000:2.0:1787602493.041220:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602493.041330:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853648512:0@lo:400:kworker.0 00000100:00100000:1.0:1787602493.041366:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602493.041384:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787602493.041389:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853648384:0@lo:400:kworker.0 00000100:00100000:1.0:1787602493.041408:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602493.041423:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853648896:0@lo:400:kworker.0 00000100:00100000:1.0:1787602493.041440:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602493.041467:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853648768 00000100:00100000:1.0:1787602493.041476:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853648768 00000100:00100000:1.0:1787602493.041523:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853648512 00000100:00100000:1.0:1787602493.041526:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853648512 00000100:00100000:1.0:1787602493.041535:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853648384 00000100:00100000:1.0:1787602493.041537:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853648384 00000100:00100000:1.0:1787602493.041560:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787602493.041569:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853648768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602493.041626:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853648768:12345-0@lo:400:kworker.0 Request processed in 57us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602493.041632:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787602493.041648:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787602493.041654:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853648512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602493.041683:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853648512:12345-0@lo:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602493.041689:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787602493.041700:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787602493.041705:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853648384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602493.041729:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853648384:12345-0@lo:400:kworker.0 Request processed in 24us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602493.041734:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787602493.041785:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853648640 00000100:00100000:1.0:1787602493.041789:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853648640 00000100:00100000:1.0:1787602493.041814:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853648896 00000100:00100000:1.0:1787602493.041817:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853648896 00000100:00100000:1.0:1787602493.041834:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787602493.041840:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853648640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602493.041870:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853648640:12345-0@lo:400:kworker.0 Request processed in 30us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602493.041876:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787602493.041885:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787602493.041891:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853648896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602493.041918:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853648896:12345-0@lo:400:kworker.0 Request processed in 27us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602493.041924:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787602493.041947:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602493.041951:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602493.041953:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602493.041992:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853648384:0@lo:400:kworker.0 00010000:00080000:1.0:1787602493.042006:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3503e4e680 x1874436853648896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602493.042015:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853648896:0@lo:400:kworker.0 00000100:00100000:1.0:1787602493.042023:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853648512:0@lo:400:kworker.0 00010000:00080000:1.0:1787602493.042051:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3503e4d500 x1874436853648640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602493.042058:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853648640:0@lo:400:kworker.0 00000100:00100000:1.0:1787602493.042080:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853648768:0@lo:400:kworker.0 00010000:00010000:1.0:1787602493.104726:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602493.549341:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602493.549385:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853649024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602493.549459:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602493.549534:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853649024 00000100:00100000:3.0:1787602493.549552:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853649024 00000100:00100000:3.0:1787602493.549601:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787602493.549610:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853649024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602493.549645:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602493.549693:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853649024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602493.549702:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1787602493.549767:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534975500 x1874436853649024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602493.549785:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853649024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602493.654071:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602493.654165:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602493.654193:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602493.654232:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833689216 00000100:00100000:1.0:1787602493.654244:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833689216 00000100:00100000:1.0:1787602493.654306:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 245 00000100:00100000:1.0:1787602493.654318:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2352:x1874436833689216:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602493.654390:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2352:x1874436833689216:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 74us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602493.654397:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 245 00000100:00100000:1.0:1787602493.654431:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833689472 00000100:00100000:1.0:1787602493.654435:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833689472 00000100:00100000:1.0:1787602493.654468:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833689344 00000100:00100000:1.0:1787602493.654471:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833689344 00000100:00100000:1.0:1787602493.654489:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 94 00000100:00100000:1.0:1787602493.654497:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833689472:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602493.654529:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833689472:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 33us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602493.654535:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 94 00000100:00100000:1.0:1787602493.654557:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 95 00000100:00100000:1.0:1787602493.654563:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833689344:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602493.654586:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833689344:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 24us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602493.654612:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 95 00000100:00080000:1.0:1787602493.657664:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787602494.124965:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602495.148957:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602495.603666:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853649152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602495.603808:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602495.603909:0:10486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853649152 00000100:00100000:2.0:1787602495.603917:0:10486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853649152 00000100:00100000:2.0:1787602495.603977:0:10486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787602495.603989:0:10486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853649152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602495.604027:0:10486:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787602495.607313:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602495.617718:0:10486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853649152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13717us (13894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602495.617734:0:10486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787602495.619711:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d21b100 x1874436853649152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602495.619804:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853649152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787602496.172900:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787602496.415442:0:11365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787602497.199556:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602498.160318:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787602498.160341:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853649280:0@lo:400:kworker.0 00000100:00100000:3.0:1787602498.160411:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602498.160491:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853649280 00000100:00100000:3.0:1787602498.160498:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853649280 00000100:00100000:3.0:1787602498.160545:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787602498.160554:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853649280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602498.160606:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853649280:12345-0@lo:400:kworker.0 Request processed in 52us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602498.160613:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787602498.160664:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853649280:0@lo:400:kworker.0 00000100:00100000:3.0:1787602498.160706:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853649408:0@lo:400:kworker.0 00000100:00100000:3.0:1787602498.160734:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602498.160992:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853649536:0@lo:400:kworker.0 00000100:00100000:2.0:1787602498.161021:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602498.161051:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853649408 00000100:00100000:2.0:1787602498.161055:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853649408 00000100:00100000:2.0:1787602498.161081:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853649536 00000100:00100000:2.0:1787602498.161084:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853649536 00000100:00100000:2.0:1787602498.161107:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787602498.161114:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853649408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602498.161144:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853649408:12345-0@lo:400:kworker.0 Request processed in 31us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602498.161150:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787602498.161177:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787602498.161183:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853649536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602498.161212:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853649536:12345-0@lo:400:kworker.0 Request processed in 30us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602498.161218:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787602498.161249:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853649536:0@lo:400:kworker.0 00000100:00100000:2.0:1787602498.161291:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787602498.161297:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853649920:0@lo:400:kworker.0 00000100:00100000:2.0:1787602498.161340:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602498.161369:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853649920 00000100:00100000:2.0:1787602498.161375:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853649920 00000100:00100000:2.0:1787602498.161403:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787602498.161410:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853649920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602498.161443:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853649920:12345-0@lo:400:kworker.0 Request processed in 35us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602498.161449:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1787602498.161488:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3503e4e680 x1874436853649920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602498.161499:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853649920:0@lo:400:kworker.0 00000100:00100000:2.0:1787602498.161538:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853649664:0@lo:400:kworker.0 00000100:00100000:2.0:1787602498.161562:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602498.161581:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602498.161586:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853649792:0@lo:400:kworker.0 00000100:00100000:2.0:1787602498.161607:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602498.161630:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853649664 00000100:00100000:2.0:1787602498.161639:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853649664 00000100:00100000:2.0:1787602498.161666:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787602498.161672:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853649664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602498.161708:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853649664:12345-0@lo:400:kworker.0 Request processed in 36us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602498.161713:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787602498.161729:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853649792 00000100:00100000:2.0:1787602498.161733:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853649792 00000100:00100000:2.0:1787602498.161780:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787602498.161786:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853649792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602498.162334:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853649408:0@lo:400:kworker.0 00010000:00080000:3.0:1787602498.162375:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3503e4c380 x1874436853649664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602498.162385:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853649664:0@lo:400:kworker.0 00000100:00080000:1.0:1787602498.162557:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602498.162561:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602498.162564:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602498.163453:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853649792:12345-0@lo:400:kworker.0 Request processed in 1661us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602498.163475:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787602498.163587:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853649792:0@lo:400:kworker.0 00010000:00010000:1.0:1787602498.220880:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602498.669180:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853650048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602498.669253:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602498.670013:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853650048 00000100:00100000:3.0:1787602498.670022:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853650048 00000100:00100000:3.0:1787602498.670078:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787602498.670088:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853650048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602498.670124:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602498.670192:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853650048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602498.670199:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787602498.670371:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534976d80 x1874436853650048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602498.670390:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853650048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602498.772947:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602498.772990:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602498.773019:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602498.773045:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833689600 00000100:00100000:1.0:1787602498.773054:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833689600 00000100:00100000:1.0:1787602498.773102:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 247 00000100:00100000:1.0:1787602498.773113:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2352:x1874436833689600:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602498.773184:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2352:x1874436833689600:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 73us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602498.773193:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 247 00000100:00100000:1.0:1787602498.773225:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833689728 00000100:00100000:1.0:1787602498.773229:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833689728 00000100:00100000:1.0:1787602498.773262:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833689856 00000100:00100000:1.0:1787602498.773275:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833689856 00000100:00100000:1.0:1787602498.773314:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 99 00000100:00100000:1.0:1787602498.773321:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833689728:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602498.773369:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833689728:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 47us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602498.773376:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 99 00000100:00100000:1.0:1787602498.773391:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 100 00000100:00100000:1.0:1787602498.773397:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833689856:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602498.773421:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833689856:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602498.773426:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 100 00000100:00080000:1.0:1787602498.773561:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787602499.244906:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602500.269187:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602500.724101:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853650176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602500.724180:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602500.724349:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853650176 00000100:00100000:3.0:1787602500.724358:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853650176 00000100:00100000:3.0:1787602500.724440:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787602500.724452:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853650176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602500.724490:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602500.724538:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853650176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602500.724546:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1787602500.724600:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787602500.725006:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d21a680 x1874436853650176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602500.725028:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853650176:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787602500.972731:0:11465:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 16:15:00 (1787602500) === 00000100:00100000:1.0:1787602501.253192:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602501.253261:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602501.253354:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833689984 00000100:00100000:2.0:1787602501.253365:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833689984 00000100:00100000:2.0:1787602501.253450:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:2.0:1787602501.253462:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833689984:12345-192.168.201.26@tcp:41:mkdir.0 00000004:00000024:2.0:1787602501.253520:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787602501.253620:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833689984:12345-192.168.201.26@tcp:41:mkdir.0 Request processed in 161us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602501.253627:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00080000:1.0:1787602501.253785:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602501.254352:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833690112 00000100:00100000:3.0:1787602501.254360:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833690112 00000100:00100000:3.0:1787602501.254399:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:3.0:1787602501.254417:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:9676:x1874436833690112:12345-192.168.201.26@tcp:700:mkdir.0 00000100:00100000:3.0:1787602501.254484:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:9676:x1874436833690112:12345-192.168.201.26@tcp:700:mkdir.0 Request processed in 70us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602501.254492:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:1.0:1787602501.263704:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602501.263932:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833690368 00000100:00100000:3.0:1787602501.263942:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833690368 00000100:00100000:3.0:1787602501.264012:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:3.0:1787602501.264035:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:9676:x1874436833690368:12345-192.168.201.26@tcp:36:mkdir.0 00010000:00010000:3.0:1787602501.264090:0:8208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602501.264166:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3500031800/0x3640686da09db1b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22b4 expref: 6 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.264187:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502000) 00010000:00010000:3.0:1787602501.264198:0:8208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602501.264585:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2d5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.264610:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.264621:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.264650:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db2dc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.264658:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db2dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.264664:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db2dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602501.265962:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787602501.265978:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.265986:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2d5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.266003:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.266009:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602501.266013:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.266021:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2d5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.266033:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7c00) 00010000:00010000:3.0:1787602501.266037:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602501.266041:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2d5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.266047:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2d5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787602501.266066:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c54565d0 reply state 00000000a5132e9e transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db2dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602501.266076:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787602501.266170:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:9676:x1874436833690368:12345-192.168.201.26@tcp:36:mkdir.0 Request processed in 2134us (2475us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787602501.266180:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:1.0:1787602501.293807:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00010000:00010000:1.0:1787602501.293883:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602501.294056:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833690496 00000100:00100000:3.0:1787602501.294075:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833690496 00000100:00100000:3.0:1787602501.294174:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:3.0:1787602501.294187:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:9678:x1874436833690496:12345-192.168.201.26@tcp:101:chmod.0 00010000:00010000:2.0:1787602501.294216:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db2dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.294230:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db2dc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.294237:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db2dc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.294242:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602501.294256:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602501.294261:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db2dc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.294271:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db2dc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.294291:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db2e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2339 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.294292:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d3529dc7800) 00010000:00010000:2.0:1787602501.294302:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602501.294309:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db2dc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.294319:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db2dc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.294474:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09db2ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.294486:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09db2ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.294496:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09db2ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602501.294570:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787602501.294575:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602501.294649:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09db2ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.294684:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db2e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2339 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.294701:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09db2ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2339 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.294715:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:2.0:1787602501.294717:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787602501.294720:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503703e00, rc 0) 00000100:00100000:2.0:1787602501.294821:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:9678:x1874436833690496:12345-192.168.201.26@tcp:101:chmod.0 Request processed in 636us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602501.294831:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:2.0:1787602501.299208:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602501.299499:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833690752 00000100:00100000:3.0:1787602501.299511:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833690752 00000100:00100000:3.0:1787602501.299569:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:3.0:1787602501.299579:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:9678:x1874436833690752:12345-192.168.201.26@tcp:36:chmod.0 00010000:00010000:3.0:1787602501.299887:0:8208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602501.299915:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09db2ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2339 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.299936:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:3.0:1787602501.299949:0:8208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602501.299986:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2f1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.300001:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.300011:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787602501.300348:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002820dff7 reply state 00000000cb11404f transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602501.300358:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787602501.300371:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787602501.300692:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+8:9678:x1874436833690752:12345-192.168.201.26@tcp:36:chmod.0 Request processed in 1113us (1495us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787602501.300707:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 17 00010000:00010000:0.0:1787602501.302470:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.302493:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2f1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.302502:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2f1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.302508:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602501.302513:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2f1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.302533:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2f1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.302551:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7c00) 00010000:00010000:0.0:1787602501.302555:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787602501.302559:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2f1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.302565:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db2f1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602501.365993:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602501.366075:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833690880 00000100:00100000:1.0:1787602501.366087:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833690880 00000100:00100000:1.0:1787602501.366155:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:1.0:1787602501.366178:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+7:9682:x1874436833690880:12345-192.168.201.26@tcp:101:chown.0 00010000:00010000:1.0:1787602501.366205:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602501.366232:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3528f20c00/0x3640686da09db2f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2340 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602501.366332:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3528f21c00/0x3640686da09db2ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602501.366346:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3528f21c00/0x3640686da09db2ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602501.366360:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3528f21c00/0x3640686da09db2ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602501.366464:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787602501.366469:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602501.366514:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3528f21c00/0x3640686da09db2ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602501.366546:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3528f20c00/0x3640686da09db2f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2340 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602501.366569:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3528f21c00/0x3640686da09db2ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2340 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602501.366578:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:1.0:1787602501.366581:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602501.366584:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3528f21c00, rc 0) 00000100:00100000:1.0:1787602501.366664:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+8:9682:x1874436833690880:12345-192.168.201.26@tcp:101:chown.0 Request processed in 489us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602501.366671:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:1.0:1787602501.369711:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602501.370299:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833691008 00000100:00100000:0.0:1787602501.370311:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833691008 00000100:00100000:0.0:1787602501.370424:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:0.0:1787602501.370436:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+8:9682:x1874436833691008:12345-192.168.201.26@tcp:101:chown.0 00010000:00010000:0.0:1787602501.370457:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602501.370487:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db306 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2347 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.370560:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db30d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.370576:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db30d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.370586:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db30d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.370603:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db314 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.370630:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db314 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.370638:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db314 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.370778:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09db31b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.370788:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09db31b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.370795:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09db31b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602501.370834:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787602501.370838:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602501.370876:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09db31b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.370889:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db30d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.370896:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db30d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.370969:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db30d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.370975:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a4600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602501.370979:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db30d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.370993:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db30d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.371006:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:0.0:1787602501.371009:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602501.371027:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db30d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.371034:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db30d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.371050:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db314 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.371057:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db314 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.371062:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db314 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.371067:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a4e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602501.371070:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db314 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.371075:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db314 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.371082:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d350b502f00) 00010000:00010000:0.0:1787602501.371085:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602501.371088:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db314 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.371104:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db314 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.371138:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2347 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.371151:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09db31b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2347 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.371159:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d350b502d00) 00010000:00010000:0.0:1787602501.371161:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787602501.371164:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35110a4800, rc 0) 00000100:00100000:0.0:1787602501.371229:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+9:9682:x1874436833691008:12345-192.168.201.26@tcp:101:chown.0 Request processed in 794us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602501.371236:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:2.0:1787602501.376614:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602501.376693:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833691264 00000100:00100000:3.0:1787602501.376702:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833691264 00000100:00100000:3.0:1787602501.376805:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:3.0:1787602501.376815:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+9:9682:x1874436833691264:12345-192.168.201.26@tcp:36:chown.0 00010000:00010000:3.0:1787602501.376867:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602501.376890:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09db31b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2347 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.376925:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d350b502d00) 00010000:00010000:3.0:1787602501.376935:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602501.376958:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db322 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.376970:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db322 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.376979:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db322 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787602501.470029:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1787602501.470235:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006adaff80 reply state 00000000d384d8fd transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db322 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602501.470250:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787602501.470438:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1787602501.470651:0:5838:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787602501.470675:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:9682:x1874436833691264:12345-192.168.201.26@tcp:36:chown.0 Request processed in 93856us (94065us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787602501.470684:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00010000:00010000:2.0:1787602501.470774:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db322 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.470785:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db322 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.470794:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db322 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.470800:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602501.470804:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db322 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.470812:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db322 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.470828:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:2.0:1787602501.470831:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787602501.470836:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db322 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.470849:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db322 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602501.492711:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602501.492973:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833691392 00000100:00100000:3.0:1787602501.492984:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833691392 00000100:00100000:3.0:1787602501.493046:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:3.0:1787602501.493057:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:9684:x1874436833691392:12345-192.168.201.26@tcp:101:touch.500 00010000:00010000:3.0:1787602501.493084:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602501.493107:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db329 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c234e expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787602501.512289:0:8208:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 19128us 00010000:00010000:3.0:1787602501.531643:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db330 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.531667:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db330 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.531680:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db330 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.531695:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db337 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.531701:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db337 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.531707:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db337 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.532159:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db33e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.532169:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.532182:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602501.532264:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787602501.532268:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602501.532374:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.532389:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db330 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.532395:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db330 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.532414:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db330 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.532420:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602501.532424:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db330 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.532432:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db330 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.532446:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:3.0:1787602501.532449:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602501.532453:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db330 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.532459:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db330 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.532483:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db337 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.533598:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db337 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.533615:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db337 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.533621:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602501.533625:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db337 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.533632:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db337 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.533647:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d3529dc7600) 00010000:00010000:3.0:1787602501.533650:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602501.533654:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db337 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.533660:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db337 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.533718:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db329 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c234e expref: 8 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.533734:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db33e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c234e expref: 7 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.533769:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3529dc7200) 00010000:00010000:3.0:1787602501.533771:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787602501.533773:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433200, rc 0) 00000100:00100000:3.0:1787602501.533861:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:9684:x1874436833691392:12345-192.168.201.26@tcp:101:touch.500 Request processed in 40804us (41159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602501.533869:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:2.0:1787602501.540667:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602501.540966:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833691648 00000100:00100000:3.0:1787602501.540977:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833691648 00000100:00100000:3.0:1787602501.541041:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:3.0:1787602501.541051:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+7:9684:x1874436833691648:12345-192.168.201.26@tcp:101:touch.500 00010000:00010000:3.0:1787602501.541071:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602501.541092:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db345 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2355 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.541448:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db34c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.541464:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db34c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.541475:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db34c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.541488:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db353 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.541608:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.541627:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787602501.543764:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787602501.544069:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db35a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.544084:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db35a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.544095:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db35a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.544131:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db34c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.544138:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db34c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.544146:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db34c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.544152:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602501.544156:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db34c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.544164:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db34c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.544178:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3529dc7200) 00010000:00010000:3.0:1787602501.544181:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602501.544194:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db34c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.544200:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db34c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787602501.544216:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059e7128a reply state 0000000035167e61 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602501.544226:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787602501.544265:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db345 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2355 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.544280:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db35a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2355 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.544287:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d3529dc7900) 00010000:00010000:3.0:1787602501.544289:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602501.544292:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432000, rc 0) 00000100:00100000:3.0:1787602501.544374:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+10:9684:x1874436833691648:12345-192.168.201.26@tcp:101:touch.500 Request processed in 3324us (3718us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787602501.544383:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 22 00010000:00010000:0.0:1787602501.548984:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.549004:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db353 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.549012:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db353 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.549018:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602501.549023:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db353 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.549052:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db353 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.549071:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff8d3529dc7a00) 00010000:00010000:0.0:1787602501.549074:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602501.549079:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db353 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.549085:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db353 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602501.560552:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602501.560781:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833691904 00000100:00100000:0.0:1787602501.560794:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833691904 00000100:00100000:0.0:1787602501.560853:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:0.0:1787602501.560863:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+9:9684:x1874436833691904:12345-192.168.201.26@tcp:36:touch.500 00010000:00010000:0.0:1787602501.560929:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602501.560959:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db35a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2355 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.560981:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d3529dc7900) 00010000:00010000:0.0:1787602501.560992:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602501.561059:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db368 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.561072:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db368 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.561080:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db368 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787602501.561249:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1a1c0ba reply state 00000000bd770b01 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db368 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602501.561259:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602501.561360:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+10:9684:x1874436833691904:12345-192.168.201.26@tcp:36:touch.500 Request processed in 497us (818us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787602501.561369:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:2.0:1787602501.565475:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00010000:00010000:0.0:1787602501.577528:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db368 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.577548:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db368 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.577555:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db368 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.577561:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a4c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602501.577566:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db368 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.577574:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db368 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.577592:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d350b502500) 00010000:00010000:0.0:1787602501.577596:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602501.577600:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db368 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.577606:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db368 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602501.580041:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833692032 00000100:00100000:3.0:1787602501.580057:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833692032 00000100:00100000:2.0:1787602501.580211:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:2.0:1787602501.580222:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+9:9684:x1874436833692032:12345-192.168.201.26@tcp:101:touch.500 00010000:00010000:2.0:1787602501.580246:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602501.580268:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09db36f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c235c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.580324:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09db36f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c235c expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.580337:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09db36f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c235c expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602501.580369:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d3504d95300) 00010000:00010000:2.0:1787602501.580372:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602501.580375:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503703e00, rc 0) 00000100:00100000:2.0:1787602501.580471:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+10:9684:x1874436833692032:12345-192.168.201.26@tcp:101:touch.500 Request processed in 250us (15076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602501.580488:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:2.0:1787602501.595904:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602501.596028:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833692160 00000100:00100000:1.0:1787602501.596038:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833692160 00000100:00100000:1.0:1787602501.596087:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:1.0:1787602501.596095:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1874436833692160:12345-192.168.201.26@tcp:8:touch.500 00010000:00080000:1.0:1787602501.596127:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:1.0:1787602501.596160:0:6691:0:(genops.c:1385:class_connect()) connect: client e3aefeab-67b4-4a0a-9090-6916c4553638, cookie 0x3640686da09db376 00002000:00100000:1.0:1787602501.596173:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e3aefeab-67b4-4a0a-9090-6916c4553638/ffff8d3502f3e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787602501.596187:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787602501.596457:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787602501.596508:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8d3502f38800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602501.596885:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2350:x1874436833692160:12345-192.168.201.26@tcp:8:touch.500 Request processed in 786us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602501.596894:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:1.0:1787602501.617893:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602501.617993:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833692288 00000100:00100000:2.0:1787602501.618018:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833692288 00000100:00100000:2.0:1787602501.618098:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:2.0:1787602501.618112:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d21a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+6:0:x1874436833692288:12345-192.168.201.26@tcp:2:touch.500 00000100:00080000:1.0:1787602501.618712:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602501.735406:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d21a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+7:0:x1874436833692288:12345-192.168.201.26@tcp:2:touch.500 Request processed in 117279us (117506us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787602501.735419:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 17 00000001:00100000:1.0:1787602501.735455:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e3aefeab-67b4-4a0a-9090-6916c4553638 00000001:00080000:1.0:1787602501.735480:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1787602501.740321:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602501.740478:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833692544 00000100:00100000:0.0:1787602501.740489:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833692544 00000100:00100000:0.0:1787602501.740552:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:0.0:1787602501.740563:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+10:9684:x1874436833692544:12345-192.168.201.26@tcp:35:touch.500 00000100:00100000:0.0:1787602501.740986:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+11:9684:x1874436833692544:12345-192.168.201.26@tcp:35:touch.500 Request processed in 424us (675us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787602501.740995:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:2.0:1787602501.761272:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602501.761605:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833692672 00000100:00100000:0.0:1787602501.761616:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833692672 00000100:00100000:0.0:1787602501.761678:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:0.0:1787602501.761691:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+11:9685:x1874436833692672:12345-192.168.201.26@tcp:101:rm.0 00010000:00010000:0.0:1787602501.761718:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602501.761791:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db37d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2363 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.761861:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db384 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.761875:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db384 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.761886:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db384 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602501.761949:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787602501.761953:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602501.761993:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db384 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.762033:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db37d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2363 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.762056:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db384 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2363 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.762064:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3529dc7200) 00010000:00010000:0.0:1787602501.762068:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787602501.762072:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35110a4e00, rc 0) 00000100:00100000:0.0:1787602501.762230:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+12:9685:x1874436833692672:12345-192.168.201.26@tcp:101:rm.0 Request processed in 542us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602501.762239:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:2.0:1787602501.790581:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602501.790703:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833692928 00000100:00100000:0.0:1787602501.790714:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833692928 00000100:00100000:0.0:1787602501.790808:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00100000:0.0:1787602501.790820:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+12:9685:x1874436833692928:12345-192.168.201.26@tcp:101:rm.0 00010000:00010000:0.0:1787602501.790843:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602501.790866:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db38b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c236a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602501.790978:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787602501.791143:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db38b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c236a expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.791159:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:0.0:1787602501.791163:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602501.791176:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db38b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c236a expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.791195:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35110a4c00, rc 0) 00000100:00100000:0.0:1787602501.791267:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+13:9685:x1874436833692928:12345-192.168.201.26@tcp:101:rm.0 Request processed in 449us (696us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787602501.791275:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00100000:2.0:1787602501.798562:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602501.799024:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833693056 00000100:00100000:0.0:1787602501.799035:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833693056 00000100:00100000:0.0:1787602501.799096:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:0.0:1787602501.799107:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+13:9685:x1874436833693056:12345-192.168.201.26@tcp:37:rm.0 00000100:00100000:1.0:1787602501.828862:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+13:9685:x1874436833693056:12345-192.168.201.26@tcp:37:rm.0 Request processed in 29744us (30299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602501.828875:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:2.0:1787602501.833566:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602501.833675:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833693312 00000100:00100000:1.0:1787602501.833685:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833693312 00000100:00100000:1.0:1787602501.833776:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:1.0:1787602501.833800:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35079d1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+13:9685:x1874436833693312:12345-192.168.201.26@tcp:35:rm.0 00000100:00100000:1.0:1787602501.834031:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35079d1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+14:9685:x1874436833693312:12345-192.168.201.26@tcp:35:rm.0 Request processed in 233us (477us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787602501.834039:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:2.0:1787602501.843649:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602501.843775:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833693568 00000100:00100000:3.0:1787602501.843787:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833693568 00000100:00100000:3.0:1787602501.843856:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 27 00000100:00100000:3.0:1787602501.843868:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+14:9685:x1874436833693568:12345-192.168.201.26@tcp:101:rm.0 00010000:00010000:3.0:1787602501.843894:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602501.843917:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db399 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2371 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.844064:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db3a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.844080:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db3a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.844092:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db3a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602501.844104:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787602501.844249:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db399 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2371 expref: 17 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.844269:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db3a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2371 expref: 16 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.844278:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3529dc7200) 00010000:00010000:3.0:1787602501.844281:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787602501.844285:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433800, rc 0) 00000100:00100000:3.0:1787602501.844350:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+16:9685:x1874436833693568:12345-192.168.201.26@tcp:101:rm.0 Request processed in 484us (710us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787602501.844357:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 27 00000100:00100000:2.0:1787602501.847957:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602501.848054:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833693696 00000100:00100000:0.0:1787602501.848065:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833693696 00000100:00100000:0.0:1787602501.848126:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00100000:0.0:1787602501.848136:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+16:9685:x1874436833693696:12345-192.168.201.26@tcp:41:rm.0 00000004:00000024:0.0:1787602501.848194:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787602501.848266:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+16:9685:x1874436833693696:12345-192.168.201.26@tcp:41:rm.0 Request processed in 132us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602501.848273:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00100000:2.0:1787602501.853178:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602501.853625:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833693824 00000100:00100000:3.0:1787602501.853635:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833693824 00000100:00100000:3.0:1787602501.853697:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 29 00000100:00100000:3.0:1787602501.853707:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+16:9685:x1874436833693824:12345-192.168.201.26@tcp:101:rm.0 00010000:00010000:3.0:1787602501.853737:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602501.853805:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db3ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2378 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.853871:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.853885:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.853895:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.853909:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.853916:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.853922:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854024:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db3c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854031:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854038:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602501.854063:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787602501.854067:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602501.854082:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854098:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854106:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854113:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854120:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854126:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602501.854130:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854137:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854148:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3529dc7200) 00010000:00010000:3.0:1787602501.854151:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602501.854154:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854159:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854171:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854177:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854187:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854192:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602501.854195:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854200:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854207:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff8d3529dc7300) 00010000:00010000:3.0:1787602501.854209:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602501.854212:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854218:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854249:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db3ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2378 expref: 18 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854263:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2378 expref: 17 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.854269:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d3504d95300) 00010000:00010000:3.0:1787602501.854271:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602501.854274:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433e00, rc 0) 00000100:00100000:3.0:1787602501.854345:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+17:9685:x1874436833693824:12345-192.168.201.26@tcp:101:rm.0 Request processed in 638us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602501.854362:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 29 00000100:00100000:2.0:1787602501.860524:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602501.860663:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833694080 00000100:00100000:0.0:1787602501.860675:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833694080 00000100:00100000:0.0:1787602501.860739:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 30 00000100:00100000:0.0:1787602501.860779:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+17:9685:x1874436833694080:12345-192.168.201.26@tcp:36:rm.0 00010000:00010000:0.0:1787602501.860835:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787602501.860863:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db3c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2378 expref: 17 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.860903:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09db36f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c235c expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.860914:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d3504d95300) 00010000:00010000:0.0:1787602501.860928:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db384 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2363 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.860939:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3529dc7200) 00010000:00010000:0.0:1787602501.860942:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602501.860961:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db3ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.860973:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db3ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.860982:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db3ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.860995:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db3d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.861001:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db3d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.861007:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db3d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.861126:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db3d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.861145:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db3d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.861152:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db3d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787602501.861940:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787602501.861952:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 286808208330ns, next at 287808205812ns, rc = 0 00010000:00010000:0.0:1787602501.862022:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09db3df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862032:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09db3df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862041:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09db3df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862048:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09db3df lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862055:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09db3df lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862062:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09db3df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862082:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787602501.862103:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db3d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862108:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db3d8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862122:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db3d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862128:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a5400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602501.862133:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db3d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862141:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db3d8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862152:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d350b502f00) 00010000:00010000:0.0:1787602501.862155:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787602501.862158:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db3d8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862165:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db3d8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862185:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db3ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862192:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db3ca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862197:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db3ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862203:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a4c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602501.862206:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db3ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862221:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db3ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862231:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3529dc7200) 00010000:00010000:0.0:1787602501.862233:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602501.862236:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db3ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.862241:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db3ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787602501.862253:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f675fe9 reply state 0000000085272618 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db3d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602501.862262:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602501.862362:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+16:9685:x1874436833694080:12345-192.168.201.26@tcp:36:rm.0 Request processed in 1583us (1845us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787602501.862371:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 30 00010000:00010000:1.0:1787602501.862848:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602501.862856:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09db3df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602501.862863:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a5a00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602501.862866:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09db3df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602501.862873:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09db3df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602501.862882:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d350b502f00) 00010000:00010000:1.0:1787602501.862885:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787602501.862888:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09db3df lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602501.862894:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09db3df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602501.862910:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602501.862912:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602501.862913:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602501.869247:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db3d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.869266:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db3d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.869275:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db3d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.869282:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a4600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602501.869288:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db3d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.869315:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db3d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.869334:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff8d350b502500) 00010000:00010000:0.0:1787602501.869337:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602501.869342:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db3d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.869349:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db3d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602501.871722:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602501.872346:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833694336 00000100:00100000:1.0:1787602501.872355:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833694336 00000100:00100000:1.0:1787602501.872426:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:1.0:1787602501.872437:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+15:9685:x1874436833694336:12345-192.168.201.26@tcp:35:rm.0 00000100:00100000:1.0:1787602501.873334:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+16:9685:x1874436833694336:12345-192.168.201.26@tcp:35:rm.0 Request processed in 895us (1619us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787602501.873344:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:2.0:1787602501.875983:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602501.876065:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833694592 00000100:00100000:3.0:1787602501.876076:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833694592 00000100:00100000:3.0:1787602501.876136:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00100000:3.0:1787602501.876146:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+16:9685:x1874436833694592:12345-192.168.201.26@tcp:36:rm.0 00010000:00010000:3.0:1787602501.876207:0:8208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787602501.876231:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db3a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2371 expref: 16 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.876266:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db33e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c234e expref: 15 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.876277:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3529dc7200) 00010000:00010000:3.0:1787602501.876293:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3528f21c00/0x3640686da09db2ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2340 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.876305:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:3.0:1787602501.876311:0:8208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602501.876337:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db3e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.876348:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db3e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.876358:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db3e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.876371:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3ed lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.876403:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.876421:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.876822:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.876831:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.876838:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602501.877441:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787602501.877458:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.877466:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3f4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.877473:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.877479:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602501.877483:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.877490:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3f4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.877513:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d3529dc7000) 00010000:00010000:3.0:1787602501.877516:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787602501.877520:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3f4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.877526:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433600/0x3640686da09db3f4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.877547:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db3e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.877553:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db3e6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.877559:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db3e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.877563:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602501.877566:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db3e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.877572:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db3e6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.877579:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7300) 00010000:00010000:3.0:1787602501.877581:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602501.877584:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db3e6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602501.877589:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db3e6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787602501.877613:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ebb4077 reply state 00000000b129432e transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602501.877623:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787602501.877694:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+15:9685:x1874436833694592:12345-192.168.201.26@tcp:36:rm.0 Request processed in 1547us (1717us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787602501.877701:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 31 00010000:00010000:0.0:1787602501.884343:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.884362:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3ed lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.884370:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3ed lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.884376:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602501.884381:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3ed lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.884388:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3ed lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.884415:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d3529dc7600) 00010000:00010000:0.0:1787602501.884419:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602501.884424:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3ed lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602501.884448:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db3ed lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602502.317564:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602503.277144:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853650432:0@lo:400:kworker.0 00000100:00100000:3.0:1787602503.277269:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602503.277344:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d102300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853650944:0@lo:400:kworker.0 00000100:00100000:3.0:1787602503.277431:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602503.277471:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602503.277478:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874436853650560:0@lo:400:kworker.0 00000100:00100000:3.0:1787602503.277504:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602503.277548:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853650432 00000100:00100000:3.0:1787602503.277557:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853650432 00000100:00100000:3.0:1787602503.277613:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853650560 00000100:00100000:3.0:1787602503.277616:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853650560 00000100:00100000:3.0:1787602503.277653:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787602503.277664:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853650432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602503.277832:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853650432:12345-0@lo:400:kworker.0 Request processed in 168us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602503.277841:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787602503.277862:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787602503.277995:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874436853650560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602503.278028:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874436853650560:12345-0@lo:400:kworker.0 Request processed in 37us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602503.278045:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1787602503.278071:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602503.278110:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874436853650560:0@lo:400:kworker.0 00000100:00100000:3.0:1787602503.278133:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853650432:0@lo:400:kworker.0 00000100:00100000:0.0:1787602503.278181:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853650688:0@lo:400:kworker.0 00000100:00100000:0.0:1787602503.278223:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602503.278268:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787602503.278276:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853650304:0@lo:400:kworker.0 00000100:00100000:0.0:1787602503.278307:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602503.278333:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853650816:0@lo:400:kworker.0 00000100:00100000:0.0:1787602503.278356:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602503.278408:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853650816 00000100:00100000:0.0:1787602503.278413:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853650816 00000100:00100000:0.0:1787602503.278574:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787602503.278583:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853650816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602503.278625:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853650816:12345-0@lo:400:kworker.0 Request processed in 44us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602503.278632:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787602503.278657:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853650304 00000100:00100000:0.0:1787602503.278661:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853650304 00000100:00100000:0.0:1787602503.278689:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787602503.278696:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853650304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602503.278729:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853650304:12345-0@lo:400:kworker.0 Request processed in 34us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602503.278736:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:0.0:1787602503.278797:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602503.278814:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853650304:0@lo:400:kworker.0 00000100:00100000:0.0:1787602503.278852:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853650816:0@lo:400:kworker.0 00000100:00100000:2.0:1787602503.279026:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853650944 00000100:00100000:2.0:1787602503.279031:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853650944 00000100:00100000:2.0:1787602503.279077:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853650688 00000100:00100000:2.0:1787602503.279080:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853650688 00000100:00100000:2.0:1787602503.279118:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787602503.279135:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853650944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602503.279186:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853650944:12345-0@lo:400:kworker.0 Request processed in 60us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602503.279192:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787602503.279206:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787602503.279212:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853650688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602503.279245:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853650688:12345-0@lo:400:kworker.0 Request processed in 33us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602503.279262:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1787602503.279303:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d100380 x1874436853650688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602503.279314:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853650688:0@lo:400:kworker.0 00010000:00080000:2.0:1787602503.279342:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d102300 x1874436853650944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602503.279353:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d102300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853650944:0@lo:400:kworker.0 00000100:00080000:0.0:1787602503.279652:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787602503.279656:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787602503.351380:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602503.790115:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602503.790147:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853651072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602503.790243:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602503.790329:0:10486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853651072 00000100:00100000:3.0:1787602503.790341:0:10486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853651072 00000100:00100000:3.0:1787602503.790417:0:10486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787602503.790429:0:10486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853651072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602503.790488:0:10486:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602503.790545:0:10486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853651072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602503.790554:0:10486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787602503.790606:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353534c380 x1874436853651072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602503.790629:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853651072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602503.903984:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602503.904048:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602503.904085:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602503.904121:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602503.904166:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833694848 00000100:00100000:2.0:1787602503.904179:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833694848 00000100:00100000:2.0:1787602503.904263:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833695104 00000100:00100000:2.0:1787602503.904267:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833695104 00000100:00100000:2.0:1787602503.904296:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 104 00000100:00100000:2.0:1787602503.904309:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+14:2354:x1874436833694848:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602503.904444:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+14:2354:x1874436833694848:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 126us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602503.904453:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 104 00000100:00100000:2.0:1787602503.904475:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 105 00000100:00100000:2.0:1787602503.904482:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2354:x1874436833695104:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602503.904510:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2354:x1874436833695104:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 29us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602503.904539:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 105 00000100:00080000:2.0:1787602503.904560:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602503.904816:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833694976 00000100:00100000:3.0:1787602503.904823:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833694976 00000100:00100000:3.0:1787602503.904877:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:3.0:1787602503.904886:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833694976:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602503.904926:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833694976:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 42us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602503.904945:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:1.0:1787602503.905193:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833694720 00000100:00100000:1.0:1787602503.905199:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833694720 00000100:00100000:1.0:1787602503.905241:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 249 00000100:00100000:1.0:1787602503.905249:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833694720:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602503.905289:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833694720:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 41us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602503.905297:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 249 00000100:00080000:2.0:1787602503.908309:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787602504.364945:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602505.390534:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602505.838022:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:0.0:1787602505.838076:0:6992:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 290784330956ns, next at 291784327591ns, rc = 0 00000100:00100000:3.0:1787602505.838394:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853651200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602505.838492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602505.838901:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853651200 00000100:00100000:0.0:1787602505.838913:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853651200 00000100:00100000:0.0:1787602505.839012:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787602505.839025:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853651200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602505.839075:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602505.839144:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853651200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602505.839153:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1787602505.839204:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f7e680 x1874436853651200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602505.839228:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853651200:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787602505.839392:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787602506.412923:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787602506.668262:0:11614:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:0.0:1787602506.958996:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787602506.959029:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:0.0:1787602506.959033:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787602506.959046:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:0.0:1787602506.959056:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1787602506.959216:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853651328:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787602506.959320:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602506.961847:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853651328 00000100:00100000:2.0:1787602506.961869:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853651328 00000100:00100000:2.0:1787602506.961963:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787602506.961979:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853651328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787602506.962024:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1787602506.962075:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8ca646, atime: 0x6a8ca646, ctime: 0x6a8ca646, blocks: 0x1 00010000:00010000:2.0:1787602506.962085:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09db3fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602506.962106:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=291s v=(0 0) 00010000:00010000:2.0:1787602506.962112:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602506.962120:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09db3fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602506.962140:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09db3fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602506.962151:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09db3fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602506.962159:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09db3fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602506.962273:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787602506.965138:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874436853651328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3151us (5805us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787602506.965155:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1787602506.965397:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d3534f7e680/2, rc 0, transno 4294967300 00000100:00100000:2.0:1787602506.965405:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853651328:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787602506.967628:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602506.967651:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09db3fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602506.967802:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702200 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602506.967810:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09db3fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602506.967825:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09db3fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602506.967860:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09db3fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602506.967886:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09db3fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602506.973045:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602506.973052:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602506.973056:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602507.438175:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787602507.996069:0:11665:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcda9c48a0 20000000:00000080:0.0:1787602507.996095:0:11665:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d3535212800 uarg=0000000000000000 20000000:01000000:0.0:1787602507.996148:0:11665:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787602507.996157:0:11665:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787602507.996163:0:11665:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787602507.999136:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787602507.999720:0:11665:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787602508.033724:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787602508.033830:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787602508.033900:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787602508.033920:0:11665:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787602508.033948:0:11665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d3503702400/0x3640686da09db402 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.033972:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d353d433c00/0x3640686da09db2a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db29d expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.033982:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3503702a00/0x3640686da09db2b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db2ab expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.033999:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3500030800/0x3640686da09db2c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db2b9 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.034010:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3500030000/0x3640686da09db2c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c232b expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.034016:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3500030400/0x3640686da09db2ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2332 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.034041:0:11665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d3503702400/0x3640686da09db402 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.034098:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3500030400/0x3640686da09db2ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2332 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.034118:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3500030400/0x3640686da09db2ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2332 expref: 12 pid: 5829 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602508.034138:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874436853651456:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602508.034327:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3500030000/0x3640686da09db2c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c232b expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.034337:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3500030000/0x3640686da09db2c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c232b expref: 12 pid: 5829 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602508.034346:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d645180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874436853651584:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602508.034384:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3500030800/0x3640686da09db2c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db2b9 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.034393:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3500030800/0x3640686da09db2c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db2b9 expref: 18 pid: 5829 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602508.034402:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d645c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874436853651712:0@lo:104: 00000100:00100000:2.0:1787602508.034456:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787602508.034505:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3503702a00/0x3640686da09db2b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db2ab expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.034524:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d3503702a00/0x3640686da09db2b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db2ab expref: 18 pid: 5832 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602508.034533:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d646d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874436853651840:0@lo:104: 00000100:00100000:2.0:1787602508.034557:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787602508.034577:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d353d433c00/0x3640686da09db2a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09db29d expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.034585:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d353d433c00/0x3640686da09db2a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09db29d expref: 18 pid: 5829 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602508.034593:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d645f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874436853651968:0@lo:104: 00000100:00100000:2.0:1787602508.034614:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602508.034624:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353d594300 going to sleep for 11 seconds 00000100:00100000:1.0:1787602508.035444:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787602508.035470:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853651712 00000100:00100000:1.0:1787602508.035483:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853651712 00000100:00100000:1.0:1787602508.035542:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853651840 00000100:00100000:1.0:1787602508.035545:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853651840 00000100:00100000:1.0:1787602508.035556:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853651968 00000100:00100000:1.0:1787602508.035559:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853651968 00000100:00100000:1.0:1787602508.035574:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787602508.035584:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+5:11665:x1874436853651712:12345-0@lo:104: 00010000:00010000:1.0:1787602508.035602:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09db2b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db2c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.035694:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602508.035701:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+5:11665:x1874436853651712:12345-0@lo:104: Request processed in 119us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602508.035708:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787602508.035730:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787602508.035737:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d646300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+4:11665:x1874436853651840:12345-0@lo:104: 00010000:00010000:1.0:1787602508.035777:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db2ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db2b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.035819:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787602508.035825:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d646300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+4:11665:x1874436853651840:12345-0@lo:104: Request processed in 89us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602508.035846:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787602508.035858:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787602508.035864:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3404370450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:11665:x1874436853651968:12345-0@lo:104: 00010000:00010000:1.0:1787602508.035872:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db29d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db2a4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.035910:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787602508.035916:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3404370450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+3:11665:x1874436853651968:12345-0@lo:104: Request processed in 52us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602508.035923:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787602508.035974:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787602508.035982:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09db2b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db2c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.036003:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3500031600 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602508.036009:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09db2b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db2c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.036019:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09db2b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db2c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602508.036028:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09db2b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db2c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602508.036035:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787602508.036077:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09db2b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db2c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.036085:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602508.036118:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09db2b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db2c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.036126:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3500031600/0x3640686da09db2b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db2c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.036144:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787602508.036148:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db2ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db2b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.036154:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3500031a00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602508.036156:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db2ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db2b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.036162:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db2ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db2b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602508.036168:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db2ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db2b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602508.036173:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787602508.036188:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db2ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db2b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.036194:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602508.036201:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db2ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db2b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.036207:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3500031a00/0x3640686da09db2ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db2b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.036217:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602508.036225:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db29d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09db2a4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.036232:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3500031000 already unused, calling callback (ffffffffc1c3ec20) 00010000:00010000:0.0:1787602508.036453:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602508.036813:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853652096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602508.036873:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602508.036930:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602508.036937:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853652224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602508.036959:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602508.037031:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853652096 00000100:00100000:3.0:1787602508.037039:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853652096 00010000:00010000:3.0:1787602508.037076:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3500030800/0x3640686da09db2c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db2b9 expref: 19 pid: 5829 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602508.037226:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853652224 00000100:00100000:3.0:1787602508.037230:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853652224 00010000:00010000:3.0:1787602508.037413:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3503702a00/0x3640686da09db2b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db2ab expref: 20 pid: 5832 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602508.037445:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787602508.037455:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+20:3301:x1874436853652096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602508.037473:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602508.037478:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3500030800/0x3640686da09db2c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db2b9 expref: 20 pid: 5829 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602508.037491:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3500030800/0x3640686da09db2c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db2b9 expref: 20 pid: 5829 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602508.037527:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602508.037565:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+20:3301:x1874436853652096:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602508.037572:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787602508.037589:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787602508.037596:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853652224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602508.037604:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602508.037609:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3503702a00/0x3640686da09db2b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db2ab expref: 19 pid: 5832 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602508.037617:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3503702a00/0x3640686da09db2b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db2ab expref: 19 pid: 5832 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602508.037627:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602508.037650:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853652224:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602508.037656:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787602508.037777:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853652224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602508.037787:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853652096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602508.037998:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602508.038026:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602508.038044:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833695232 00000100:00100000:3.0:1787602508.038049:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833695232 00010000:00010000:3.0:1787602508.038069:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3500030400/0x3640686da09db2ce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2332 expref: 13 pid: 5829 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602508.038083:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833695360 00000100:00100000:3.0:1787602508.038094:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833695360 00010000:00010000:3.0:1787602508.038108:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3500030000/0x3640686da09db2c7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c232b expref: 14 pid: 5829 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602508.038122:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00100000:3.0:1787602508.038129:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3509d54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+14:2351:x1874436833695232:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602508.038138:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602508.038143:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3500030400/0x3640686da09db2ce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2332 expref: 14 pid: 5829 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602508.038153:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3500030400/0x3640686da09db2ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2332 expref: 14 pid: 5829 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602508.038166:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602508.038211:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3509d54c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+14:2351:x1874436833695232:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 82us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602508.038218:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00100000:0.0:1787602508.038366:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:0.0:1787602508.038378:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2352:x1874436833695360:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602508.038388:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602508.038394:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3500030000/0x3640686da09db2c7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c232b expref: 13 pid: 5829 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.038405:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3500030000/0x3640686da09db2c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c232b expref: 13 pid: 5829 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602508.038416:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602508.038439:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2352:x1874436833695360:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 64us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602508.038447:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 33 10000000:00010000:1.0:1787602508.038546:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db29d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09db2a4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.038561:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db29d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09db2a4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602508.038569:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db29d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09db2a4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602508.038576:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787602508.038609:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db29d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db2a4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.038616:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602508.038643:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db29d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db2a4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.038650:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3500031000/0x3640686da09db29d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09db2a4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.038672:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602508.038674:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602508.038676:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602508.038684:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602508.038715:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853652352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787602508.038777:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602508.038833:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853652352 00000100:00100000:1.0:1787602508.038846:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853652352 00010000:00010000:1.0:1787602508.038864:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d353d433c00/0x3640686da09db2a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db29d expref: 19 pid: 5829 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602508.038879:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787602508.038885:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d218a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853652352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787602508.038894:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602508.038898:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d353d433c00/0x3640686da09db2a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09db29d expref: 19 pid: 5829 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.038908:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d353d433c00/0x3640686da09db2a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09db29d expref: 19 pid: 5829 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.038922:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d3503702400/0x3640686da09db402 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.038932:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503702400/0x3640686da09db402 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.038949:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3503702400/0x3640686da09db402 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.038958:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d3503702400/0x3640686da09db402 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.038966:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d3503702400/0x3640686da09db402 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.038973:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d3503702400/0x3640686da09db402 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.038979:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702400 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602508.038991:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d3503702400/0x3640686da09db402 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.039000:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d3503702400/0x3640686da09db402 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.039009:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d3503702400/0x3640686da09db402 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602508.039021:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602508.039053:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d218a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853652352:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602508.039060:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787602508.039091:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853652352:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787602508.039700:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3500030400/0x3640686da09db2ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2332 expref: 12 pid: 5829 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602508.039714:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874436853651456:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602508.039727:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3500030000/0x3640686da09db2c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c232b expref: 11 pid: 5829 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602508.039734:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d645180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874436853651584:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602508.039784:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3500030800/0x3640686da09db2c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db2b9 expref: 18 pid: 5829 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602508.039793:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d645c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874436853651712:0@lo:104: 00010000:00010000:2.0:1787602508.039806:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3503702a00/0x3640686da09db2b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db2ab expref: 17 pid: 5832 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602508.039825:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d646d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874436853651840:0@lo:104: 00010000:00010000:2.0:1787602508.039839:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d353d433c00/0x3640686da09db2a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09db29d expref: 16 pid: 5829 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602508.039847:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d645f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1874436853651968:0@lo:104: 00010000:00010000:2.0:1787602508.039877:0:11665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d3503702400/0x3640686da09db402 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.039887:0:11665:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d3503702400/0x3640686da09db402 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.039894:0:11665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d3503702400/0x3640686da09db402 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602508.039901:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3503702400/0x3640686da09db402 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602508.399566:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853652736:0@lo:400:kworker.0 00000100:00100000:1.0:1787602508.399674:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602508.399805:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787602508.399812:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853652608:0@lo:400:kworker.0 00000100:00100000:1.0:1787602508.399839:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602508.399856:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853653120:0@lo:400:kworker.0 00000100:00100000:1.0:1787602508.399883:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602508.399992:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853652864:0@lo:400:kworker.0 00000100:00100000:3.0:1787602508.400027:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602508.400060:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787602508.400066:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853652480:0@lo:400:kworker.0 00000100:00100000:3.0:1787602508.400111:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602508.400137:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853652992:0@lo:400:kworker.0 00000100:00100000:3.0:1787602508.400160:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602508.400206:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853653120 00000100:00100000:3.0:1787602508.400215:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853653120 00000100:00100000:3.0:1787602508.400294:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853652864 00000100:00100000:3.0:1787602508.400298:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853652864 00000100:00100000:3.0:1787602508.400352:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787602508.400363:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853653120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602508.400434:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853653120:12345-0@lo:400:kworker.0 Request processed in 72us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602508.400443:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787602508.400462:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787602508.400469:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1874436853652864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602508.400501:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1874436853652864:12345-0@lo:400:kworker.0 Request processed in 33us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602508.400507:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787602508.400526:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853652480 00000100:00100000:3.0:1787602508.400530:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853652480 00000100:00100000:3.0:1787602508.400559:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787602508.400566:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:3303:x1874436853652480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602508.400598:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:3303:x1874436853652480:12345-0@lo:400:kworker.0 Request processed in 32us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602508.400604:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787602508.400634:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853652736 00000100:00100000:3.0:1787602508.400638:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853652736 00000100:00100000:3.0:1787602508.400666:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853652608 00000100:00100000:3.0:1787602508.400669:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853652608 00000100:00100000:3.0:1787602508.400680:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853652992 00000100:00100000:3.0:1787602508.400682:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853652992 00000100:00100000:3.0:1787602508.400694:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787602508.400700:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853652736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602508.400734:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853652736:12345-0@lo:400:kworker.0 Request processed in 34us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602508.400782:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787602508.400794:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787602508.400800:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853652608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602508.400828:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853652608:12345-0@lo:400:kworker.0 Request processed in 28us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602508.400833:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787602508.400844:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787602508.400850:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853652992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602508.400876:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853652992:12345-0@lo:400:kworker.0 Request processed in 26us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602508.400882:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1787602508.400899:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787602508.400905:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787602508.400907:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602508.400949:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853652480:0@lo:400:kworker.0 00000100:00100000:3.0:1787602508.400966:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853652992:0@lo:400:kworker.0 00000100:00100000:3.0:1787602508.400978:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853652864:0@lo:400:kworker.0 00000100:00100000:3.0:1787602508.401024:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853652608:0@lo:400:kworker.0 00010000:00080000:3.0:1787602508.401039:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d350886e300 x1874436853653120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602508.401052:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853653120:0@lo:400:kworker.0 00000100:00100000:3.0:1787602508.401062:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853652736:0@lo:400:kworker.0 00010000:00010000:0.0:1787602508.462205:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602508.909130:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787602508.909163:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853653248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602508.909264:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602508.909589:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853653248 00000100:00100000:3.0:1787602508.909608:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853653248 00000100:00100000:3.0:1787602508.909678:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787602508.909690:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853653248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602508.909764:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602508.909850:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853653248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602508.909858:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1787602508.909979:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353534c700 x1874436853653248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602524 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602508.910006:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853653248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602509.032172:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602509.032236:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602509.032282:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602509.032326:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602509.032381:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833695616 00000100:00100000:3.0:1787602509.032395:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833695616 00000100:00100000:3.0:1787602509.032485:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833695872 00000100:00100000:3.0:1787602509.032489:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833695872 00000100:00100000:3.0:1787602509.032518:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 109 00000100:00100000:3.0:1787602509.032530:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2352:x1874436833695616:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602509.033000:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2352:x1874436833695616:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 468us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602509.033011:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 109 00000100:00100000:3.0:1787602509.033036:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 110 00000100:00100000:3.0:1787602509.033045:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833695872:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602509.033077:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833695872:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 34us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602509.033084:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 110 00000100:00080000:3.0:1787602509.033732:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602509.033883:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833695488 00000100:00100000:0.0:1787602509.033893:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833695488 00000100:00100000:0.0:1787602509.033968:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 251 00000100:00100000:0.0:1787602509.033977:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:2351:x1874436833695488:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602509.034044:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:2351:x1874436833695488:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 68us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602509.034052:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 251 00000100:00100000:1.0:1787602509.036056:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833695744 00000100:00100000:1.0:1787602509.036072:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833695744 00000100:00100000:1.0:1787602509.036186:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 62 00000100:00100000:1.0:1787602509.036214:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2351:x1874436833695744:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602509.036312:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2351:x1874436833695744:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 99us (4037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602509.036320:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 62 00000100:00080000:3.0:1787602509.039290:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787602509.487539:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602509.716108:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602509.718282:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833696000 00000100:00100000:1.0:1787602509.718309:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833696000 00000100:00100000:1.0:1787602509.718677:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 252 00000100:00100000:1.0:1787602509.718693:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:5593:x1874436833696000:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602509.718720:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602509.718816:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3528f21000/0x3640686da09db409 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c237f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.718874:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3528f21000/0x3640686da09db409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c237f expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.718888:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3528f21000/0x3640686da09db409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c237f expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.718902:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3528f21000, rc 0) 00000100:00100000:1.0:1787602509.719020:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:5593:x1874436833696000:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 Request processed in 330us (2927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602509.719028:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 252 00000100:00100000:2.0:1787602509.726225:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602509.738164:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833696128 00000100:00100000:0.0:1787602509.738186:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833696128 00000100:00100000:0.0:1787602509.738295:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 253 00000100:00100000:0.0:1787602509.738307:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:5593:x1874436833696128:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602509.739679:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:5593:x1874436833696128:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 Request processed in 1365us (13463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602509.739695:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 253 00000100:00100000:3.0:1787602509.744003:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602509.748463:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833696256 00000100:00100000:1.0:1787602509.748489:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833696256 00000100:00100000:1.0:1787602509.748615:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 254 00000100:00100000:1.0:1787602509.748631:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:5593:x1874436833696256:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602509.749009:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:5593:x1874436833696256:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 Request processed in 380us (5026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602509.749018:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 254 00000100:00100000:3.0:1787602509.760434:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602509.760547:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833696384 00000100:00100000:0.0:1787602509.760564:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833696384 00000100:00100000:0.0:1787602509.760652:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 255 00000100:00100000:0.0:1787602509.760667:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:9955:x1874436833696384:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787602509.761073:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:9955:x1874436833696384:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 408us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602509.761084:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 255 00000100:00100000:2.0:1787602509.770132:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602509.772381:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833696512 00000100:00100000:3.0:1787602509.772409:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833696512 00000100:00100000:3.0:1787602509.772526:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 256 00000100:00100000:3.0:1787602509.772540:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:9955:x1874436833696512:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787602509.772994:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:9955:x1874436833696512:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 455us (2878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602509.773005:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 256 00000100:00100000:2.0:1787602509.792931:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602509.793210:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833696640 00000100:00100000:1.0:1787602509.793224:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833696640 00000100:00100000:1.0:1787602509.793316:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 257 00000100:00100000:1.0:1787602509.793327:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:5593:x1874436833696640:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602509.793350:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602509.793380:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3528f20200/0x3640686da09db410 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2386 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.793431:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3528f20200/0x3640686da09db410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2386 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.793444:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3528f20200/0x3640686da09db410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2386 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602509.793455:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3528f20200, rc 0) 00000100:00100000:1.0:1787602509.793531:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:5593:x1874436833696640:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 Request processed in 205us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602509.793538:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 257 00000100:00100000:1.0:1787602509.800116:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602509.809068:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833696768 00000100:00100000:0.0:1787602509.809095:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833696768 00000100:00100000:0.0:1787602509.809184:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 258 00000100:00100000:0.0:1787602509.809197:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:5593:x1874436833696768:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602509.810564:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:5593:x1874436833696768:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 Request processed in 1359us (10456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602509.810577:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 258 00000100:00100000:2.0:1787602509.837334:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602509.837529:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833696896 00000100:00100000:0.0:1787602509.837543:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833696896 00000100:00100000:0.0:1787602509.837622:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 259 00000100:00100000:0.0:1787602509.837634:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:5593:x1874436833696896:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602509.838008:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:5593:x1874436833696896:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 Request processed in 374us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602509.838018:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 259 00000100:00100000:2.0:1787602509.847292:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602509.847676:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833697024 00000100:00100000:1.0:1787602509.847690:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833697024 00000100:00100000:1.0:1787602509.847807:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 260 00000100:00100000:1.0:1787602509.847820:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:9958:x1874436833697024:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787602509.848172:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:9958:x1874436833697024:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 353us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602509.848181:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 260 00000100:00100000:1.0:1787602509.852639:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602509.853192:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833697152 00000100:00100000:3.0:1787602509.853205:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833697152 00000100:00100000:3.0:1787602509.853319:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 261 00000100:00100000:3.0:1787602509.853348:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:9958:x1874436833697152:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787602509.853696:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:9958:x1874436833697152:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 365us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602509.853704:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 261 10000000:01000000:0.0:1787602509.997948:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787602509.997962:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d35271fb800 from 7 10000000:01000000:0.0:1787602509.997969:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602509.998037:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.998050:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602509.998064:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602509.998101:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853653376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602509.998200:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602509.998293:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35088b0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602509.998449:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853653376 00000100:00100000:3.0:1787602509.998459:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853653376 00000100:00100000:3.0:1787602509.998550:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787602509.998563:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:5834:x1874436853653376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602509.998583:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602509.998603:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d353d433600/0x3640686da09db41e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db417 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602509.998659:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d433600/0x3640686da09db41e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db417 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602509.998671:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d353d433600/0x3640686da09db41e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db417 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602509.998683:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433600, rc 0) 00000100:00100000:3.0:1787602509.999006:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853653376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 442us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602509.999015:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787602510.002686:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853653376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602510.003882:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db41e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602510.004055:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db41e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602510.004212:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853653504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602510.004323:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602510.006683:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35088b0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602510.006918:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853653504 00000100:00100000:3.0:1787602510.006936:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853653504 00000100:00100000:3.0:1787602510.007016:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787602510.007028:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853653504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602510.007436:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853653504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 409us (3113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602510.007445:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787602510.007868:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853653504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787602510.008027:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853653632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787602510.008092:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602510.008130:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35088b0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602510.011366:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853653632 00000100:00100000:3.0:1787602510.011393:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853653632 00000100:00100000:3.0:1787602510.011526:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787602510.011540:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853653632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602510.011932:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:5834:x1874436853653632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 395us (3839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602510.011942:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787602510.012666:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853653632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602510.015999:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:11678:1874436853653760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602510.016224:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602510.016501:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3539774b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602510.016596:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853653760 00000100:00100000:1.0:1787602510.016606:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853653760 00000100:00100000:1.0:1787602510.016666:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787602510.016678:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:11678:x1874436853653760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602510.017033:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:11678:x1874436853653760:12345-0@lo:502:llog_process_th.0 Request processed in 356us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602510.017043:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787602510.017186:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:11678:1874436853653760:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787602510.017231:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602510.017244:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602510.017248:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787602510.017269:0:11678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d35271fb800 00000020:00000080:2.0:1787602510.017281:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787602510.017410:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d645f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:11678:1874436853653888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602510.017455:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602510.017491:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353d5943c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602510.021543:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853653888 00000100:00100000:3.0:1787602510.021697:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853653888 00000100:00100000:3.0:1787602510.021816:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787602510.021829:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:11678:x1874436853653888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602510.024562:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:11678:x1874436853653888:12345-0@lo:502:llog_process_th.0 Request processed in 2723us (7093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602510.024913:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d645f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:11678:1874436853653888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787602510.024987:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602510.024999:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602510.025002:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787602510.025008:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787602510.026026:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787602510.026066:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787602510.026081:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db41e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.026095:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db41e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602510.026107:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787602510.026110:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d353d79c800 from 7 10000000:01000000:1.0:1787602510.026114:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787602510.026179:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.026188:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.026218:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602510.026250:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853654016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787602510.026463:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602510.026526:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edf240 going to sleep for 11 seconds 00000100:00100000:2.0:1787602510.026662:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853654016 00000100:00100000:2.0:1787602510.026672:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853654016 00000100:00100000:2.0:1787602510.026737:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787602510.026774:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853654016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602510.026789:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602510.026807:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3503703e00/0x3640686da09db42c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db425 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.026848:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503703e00/0x3640686da09db42c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db425 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.026860:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3503703e00/0x3640686da09db42c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db425 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.026871:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503703e00, rc 0) 00000100:00100000:2.0:1787602510.026917:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853654016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602510.026924:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787602510.027284:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853654016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602510.027303:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db42c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.027313:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db42c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602510.027472:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853654144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602510.027507:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602510.027541:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edf240 going to sleep for 11 seconds 00000100:00100000:1.0:1787602510.027559:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853654144 00000100:00100000:1.0:1787602510.027563:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853654144 00000100:00100000:1.0:1787602510.027589:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787602510.027596:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853654144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602510.028231:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787602510.030597:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853654144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2731us (2820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602510.030617:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787602510.032155:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853654144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602510.032244:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d645f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853654272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602510.032343:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602510.032389:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353d594180 going to sleep for 11 seconds 00000100:00100000:1.0:1787602510.032797:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853654272 00000100:00100000:1.0:1787602510.032806:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853654272 00000100:00100000:1.0:1787602510.032873:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787602510.032892:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853654272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602510.033168:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853654272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 278us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602510.033177:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787602510.033816:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d645f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853654272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602510.035365:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d645f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:11680:1874436853654400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602510.035472:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602510.035530:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353d594300 going to sleep for 11 seconds 00000100:00100000:1.0:1787602510.035670:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853654400 00000100:00100000:1.0:1787602510.035679:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853654400 00000100:00100000:1.0:1787602510.035794:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787602510.035807:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:11680:x1874436853654400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602510.036099:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:11680:x1874436853654400:12345-0@lo:502:llog_process_th.0 Request processed in 293us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602510.036108:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787602510.036407:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d645f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:11680:1874436853654400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787602510.036448:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602510.036462:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602510.036464:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787602510.036472:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d353d79c800 00000020:00000080:3.0:1787602510.036475:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787602510.036581:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:11680:1874436853654528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602510.036625:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602510.036656:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853654528 00000100:00100000:3.0:1787602510.036661:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853654528 00000100:00100000:3.0:1787602510.036699:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787602510.036708:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:11680:x1874436853654528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602510.036871:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:11680:x1874436853654528:12345-0@lo:502:llog_process_th.0 Request processed in 163us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602510.036879:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787602510.036918:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3539774480 going to sleep for 11 seconds 00000100:00100000:3.0:1787602510.036931:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:11680:1874436853654528:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787602510.036955:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602510.036960:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602510.036961:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787602510.036965:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787602510.037510:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787602510.037536:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787602510.037553:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db42c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.037568:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db42c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602510.037580:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787602510.037584:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3509288800 from 7 10000000:01000000:1.0:1787602510.037587:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787602510.037623:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.037632:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.037642:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602510.053471:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853654656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787602510.053958:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602510.054155:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602510.062003:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853654656 00000100:00100000:0.0:1787602510.062025:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853654656 00000100:00100000:2.0:1787602510.062165:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787602510.062179:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:5834:x1874436853654656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602510.062204:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602510.062229:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3503702200/0x3640686da09db43a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09db433 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.062286:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503702200/0x3640686da09db43a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09db433 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.062300:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3503702200/0x3640686da09db43a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09db433 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602510.062311:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702200, rc 0) 00000100:00100000:2.0:1787602510.062432:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853654656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 255us (8475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602510.062440:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787602510.062618:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853654656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602510.062643:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db43a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.062654:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db43a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602510.062803:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853654784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602510.062846:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602510.062884:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602510.062900:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853654784 00000100:00100000:1.0:1787602510.062904:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853654784 00000100:00100000:1.0:1787602510.062933:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787602510.062940:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853654784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602510.063324:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853654784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 382us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602510.063333:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787602510.063379:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853654784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602510.063413:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853654912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602510.063459:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602510.063474:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602510.063494:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853654912 00000100:00100000:1.0:1787602510.063498:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853654912 00000100:00100000:1.0:1787602510.063517:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787602510.063524:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853654912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602510.063690:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:5834:x1874436853654912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602510.063697:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787602510.063736:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:5834:1874436853654912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602510.063973:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:11683:1874436853655040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602510.064007:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602510.064025:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853655040 00000100:00100000:1.0:1787602510.064028:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853655040 00000100:00100000:1.0:1787602510.064045:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787602510.064050:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:11683:x1874436853655040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602510.064185:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:11683:x1874436853655040:12345-0@lo:502:llog_process_th.0 Request processed in 133us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602510.064192:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787602510.064218:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350c8b9600 going to sleep for 11 seconds 00000100:00100000:1.0:1787602510.064228:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:11683:1874436853655040:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787602510.064249:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787602510.064276:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602510.064279:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787602510.064287:0:11683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d3509288800 00000020:00000080:1.0:1787602510.064290:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787602510.064372:0:11683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:11683:1874436853655168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602510.064404:0:11683:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602510.064429:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853655168 00000100:00100000:1.0:1787602510.064433:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853655168 00000100:00100000:1.0:1787602510.064449:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787602510.064455:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:11683:x1874436853655168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602510.064556:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:11683:x1874436853655168:12345-0@lo:502:llog_process_th.0 Request processed in 101us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602510.064563:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787602510.064588:0:11683:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350c8b9600 going to sleep for 11 seconds 00000100:00100000:1.0:1787602510.064600:0:11683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:11683:1874436853655168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787602510.064617:0:11683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602510.064622:0:11683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602510.064624:0:11683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787602510.064627:0:11683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787602510.064684:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787602510.064704:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787602510.064715:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db43a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602510.064727:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db43a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787602510.071329:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787602510.509129:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602510.959202:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853655296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602510.959329:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602510.960339:0:10486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853655296 00000100:00100000:0.0:1787602510.960354:0:10486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853655296 00000100:00100000:0.0:1787602510.960451:0:10486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787602510.960465:0:10486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874436853655296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602510.960514:0:10486:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602510.960595:0:10486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874436853655296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602510.960604:0:10486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1787602510.960711:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787602510.966620:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853655296:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787602511.087553:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787602511.534306:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787602512.062738:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1787602512.557029:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602513.517454:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853655680:0@lo:400:kworker.0 00000100:00100000:1.0:1787602513.517559:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602513.517650:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787602513.517657:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853655552:0@lo:400:kworker.0 00000100:00100000:1.0:1787602513.517692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602513.517710:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853656064:0@lo:400:kworker.0 00000100:00100000:1.0:1787602513.517738:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602513.518209:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853655808:0@lo:400:kworker.0 00000100:00100000:3.0:1787602513.518247:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602513.518287:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787602513.518293:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853655424:0@lo:400:kworker.0 00000100:00100000:3.0:1787602513.518325:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602513.518355:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853655936:0@lo:400:kworker.0 00000100:00100000:3.0:1787602513.518377:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602513.518409:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853655680 00000100:00100000:3.0:1787602513.518419:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853655680 00000100:00100000:3.0:1787602513.518480:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853655552 00000100:00100000:3.0:1787602513.518483:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853655552 00000100:00100000:3.0:1787602513.518497:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853655936 00000100:00100000:3.0:1787602513.518499:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853655936 00000100:00100000:3.0:1787602513.518515:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787602513.518525:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853655680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602513.518584:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853655680:12345-0@lo:400:kworker.0 Request processed in 61us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602513.518592:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787602513.518620:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787602513.518626:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853655552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602513.518652:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853655552:12345-0@lo:400:kworker.0 Request processed in 27us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602513.518657:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787602513.518667:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787602513.518673:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853655936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602513.518700:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853655936:12345-0@lo:400:kworker.0 Request processed in 27us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602513.518705:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787602513.518781:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853655936:0@lo:400:kworker.0 00000100:00100000:3.0:1787602513.518811:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853655552:0@lo:400:kworker.0 00000100:00100000:3.0:1787602513.518821:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853655680:0@lo:400:kworker.0 00000100:00100000:0.0:1787602513.518981:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853655424 00000100:00100000:0.0:1787602513.518986:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853655424 00000100:00100000:0.0:1787602513.519021:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787602513.519028:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853655424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602513.519073:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853655424:12345-0@lo:400:kworker.0 Request processed in 46us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602513.519079:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787602513.519308:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853655424:0@lo:400:kworker.0 00000100:00100000:2.0:1787602513.519448:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853656064 00000100:00100000:2.0:1787602513.519454:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853656064 00000100:00100000:2.0:1787602513.519508:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853655808 00000100:00100000:2.0:1787602513.519513:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853655808 00000100:00100000:2.0:1787602513.519543:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787602513.519552:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853656064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602513.519602:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853656064:12345-0@lo:400:kworker.0 Request processed in 53us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602513.519609:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787602513.519620:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787602513.519626:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853655808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602513.519658:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853655808:12345-0@lo:400:kworker.0 Request processed in 32us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602513.519664:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1787602513.519681:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787602513.519685:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787602513.519688:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602513.519714:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1787602513.519721:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d3534f7e680, transno 4294967300 00000100:00100000:2.0:1787602513.519736:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853655808:0@lo:400:kworker.0 00010000:00080000:2.0:1787602513.520514:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d350c834380 x1874436853656064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602513.520528:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853656064:0@lo:400:kworker.0 00010000:00010000:1.0:1787602513.581446:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602514.037281:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602514.037310:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853656192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602514.037404:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602514.037505:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853656192 00000100:00100000:3.0:1787602514.037515:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853656192 00000100:00100000:3.0:1787602514.037587:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787602514.037599:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853656192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602514.037648:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602514.037698:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853656192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602514.037726:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787602514.038026:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353534dc00 x1874436853656192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602514.038049:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853656192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602514.141634:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602514.141684:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602514.141722:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602514.141799:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602514.141879:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833697536 00000100:00100000:2.0:1787602514.141911:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833697536 00000100:00100000:2.0:1787602514.141994:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00100000:2.0:1787602514.142008:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2352:x1874436833697536:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602514.142113:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2352:x1874436833697536:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 108us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602514.142122:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00080000:2.0:1787602514.142148:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602514.142276:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833697280 00000100:00100000:1.0:1787602514.142281:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833697280 00000100:00100000:1.0:1787602514.142326:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 278 00000100:00100000:1.0:1787602514.142334:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2352:x1874436833697280:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602514.142366:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2352:x1874436833697280:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 34us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602514.142373:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 278 00000100:00100000:0.0:1787602514.142900:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833697408 00000100:00100000:0.0:1787602514.142909:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833697408 00000100:00100000:0.0:1787602514.142965:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833697664 00000100:00100000:0.0:1787602514.142968:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833697664 00000100:00100000:0.0:1787602514.142990:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 114 00000100:00100000:0.0:1787602514.142998:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2352:x1874436833697408:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602514.143047:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2352:x1874436833697408:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 49us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602514.143054:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 114 00000100:00100000:0.0:1787602514.143068:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 115 00000100:00100000:0.0:1787602514.143074:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833697664:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602514.143098:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833697664:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 25us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602514.143105:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 115 00000100:00080000:1.0:1787602514.143251:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787602514.610922:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602515.629828:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602516.079581:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787602516.079612:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853656320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602516.079696:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602516.079850:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853656320 00000100:00100000:3.0:1787602516.079860:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853656320 00000100:00100000:3.0:1787602516.079957:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787602516.079969:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853656320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602516.080009:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602516.080067:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853656320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602516.080075:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787602516.080586:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853656320:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787602516.080686:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787602516.654979:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602517.676977:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602518.639414:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853656832:0@lo:400:kworker.0 00000100:00100000:1.0:1787602518.639491:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602518.639554:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787602518.639561:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853656448:0@lo:400:kworker.0 00000100:00100000:1.0:1787602518.639591:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602518.639615:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853656960:0@lo:400:kworker.0 00000100:00100000:1.0:1787602518.639639:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602518.639667:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853656704:0@lo:400:kworker.0 00000100:00100000:1.0:1787602518.639702:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602518.639718:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787602518.639723:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853656576:0@lo:400:kworker.0 00000100:00100000:1.0:1787602518.639766:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602518.639781:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853657088:0@lo:400:kworker.0 00000100:00100000:1.0:1787602518.639802:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602518.639827:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853656832 00000100:00100000:1.0:1787602518.639834:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853656832 00000100:00100000:1.0:1787602518.639887:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853657088 00000100:00100000:1.0:1787602518.639890:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853657088 00000100:00100000:1.0:1787602518.639916:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787602518.639925:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853656832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602518.639978:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853656832:12345-0@lo:400:kworker.0 Request processed in 53us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602518.639985:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787602518.640001:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787602518.640007:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853657088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602518.640037:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853657088:12345-0@lo:400:kworker.0 Request processed in 30us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602518.640043:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787602518.640060:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853656448 00000100:00100000:1.0:1787602518.640063:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853656448 00000100:00100000:1.0:1787602518.640084:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787602518.640090:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853656448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602518.640129:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853656448:12345-0@lo:400:kworker.0 Request processed in 39us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602518.640145:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787602518.640172:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853656960 00000100:00100000:1.0:1787602518.640175:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853656960 00000100:00100000:1.0:1787602518.640202:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853656704 00000100:00100000:1.0:1787602518.640205:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853656704 00000100:00100000:1.0:1787602518.640217:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853656576 00000100:00100000:1.0:1787602518.640219:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853656576 00000100:00100000:1.0:1787602518.640231:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787602518.640237:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853656960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602518.640267:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853656960:12345-0@lo:400:kworker.0 Request processed in 31us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602518.640275:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787602518.640286:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787602518.640292:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853656704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602518.640315:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853656704:12345-0@lo:400:kworker.0 Request processed in 24us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602518.640321:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787602518.640331:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787602518.640337:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853656576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602518.640359:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853656576:12345-0@lo:400:kworker.0 Request processed in 23us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602518.640366:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1787602518.640381:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787602518.640385:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602518.640387:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602518.640426:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853656576:0@lo:400:kworker.0 00010000:00080000:1.0:1787602518.640450:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d350c834000 x1874436853657088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602518.640462:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853657088:0@lo:400:kworker.0 00000100:00100000:1.0:1787602518.640471:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853656704:0@lo:400:kworker.0 00000100:00100000:1.0:1787602518.640500:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853656448:0@lo:400:kworker.0 00000100:00100000:1.0:1787602518.640510:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853656960:0@lo:400:kworker.0 00000100:00100000:1.0:1787602518.640519:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853656832:0@lo:400:kworker.0 00010000:00010000:0.0:1787602518.710347:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602519.149581:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853657216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602519.150285:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602519.150905:0:10486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853657216 00000100:00100000:3.0:1787602519.150927:0:10486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853657216 00000100:00100000:3.0:1787602519.150998:0:10486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787602519.151009:0:10486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853657216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602519.151048:0:10486:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602519.151118:0:10486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853657216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602519.151126:0:10486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787602519.151210:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353534dc00 x1874436853657216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602519.151230:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853657216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602519.254835:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602519.254887:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602519.254908:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602519.254939:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602519.254973:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833697920 00000100:00100000:2.0:1787602519.254983:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833697920 00000100:00100000:2.0:1787602519.255038:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833698176 00000100:00100000:2.0:1787602519.255041:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833698176 00000100:00100000:2.0:1787602519.255061:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 119 00000100:00100000:2.0:1787602519.255070:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2353:x1874436833697920:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602519.255184:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833698048 00000100:00100000:3.0:1787602519.255189:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833698048 00000100:00100000:3.0:1787602519.255221:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00100000:3.0:1787602519.255228:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833698048:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602519.255331:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833698048:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 92us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602519.255339:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00100000:3.0:1787602519.255367:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 120 00000100:00100000:3.0:1787602519.255374:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833698176:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602519.255402:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833698176:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 29us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602519.255408:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 120 00000100:00080000:3.0:1787602519.255545:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787602519.255551:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602519.255731:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833697792 00000100:00100000:0.0:1787602519.255736:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833697792 00000100:00100000:0.0:1787602519.255797:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 280 00000100:00100000:0.0:1787602519.255805:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833697792:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602519.255839:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833697792:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 35us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602519.255855:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 280 00000100:00100000:2.0:1787602519.255981:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2353:x1874436833697920:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 910us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602519.255990:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 119 00010000:00010000:1.0:1787602519.725141:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602520.751273:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602521.197020:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602521.197048:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853657344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602521.197153:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602521.197222:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853657344 00000100:00100000:0.0:1787602521.197241:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853657344 00000100:00080000:3.0:1787602521.197299:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602521.204520:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787602521.204558:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853657344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602521.204619:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602521.204765:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853657344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 228us (7616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602521.204772:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787602521.205024:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853657344:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787602521.325594:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787602521.773039:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602522.800156:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602523.757128:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853657472:0@lo:400:kworker.0 00000100:00100000:3.0:1787602523.757212:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602523.757280:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853657984:0@lo:400:kworker.0 00000100:00100000:3.0:1787602523.757309:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602523.757339:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602523.757345:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853657856:0@lo:400:kworker.0 00000100:00100000:3.0:1787602523.757380:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602523.757415:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853657984 00000100:00100000:3.0:1787602523.757422:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853657984 00000100:00100000:3.0:1787602523.757467:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787602523.757474:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853657984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602523.757533:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853657984:12345-0@lo:400:kworker.0 Request processed in 59us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602523.757541:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787602523.757574:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853657856 00000100:00100000:3.0:1787602523.757576:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853657856 00000100:00100000:3.0:1787602523.757602:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787602523.757607:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853657856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602523.757627:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853657856:12345-0@lo:400:kworker.0 Request processed in 20us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602523.757631:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1787602523.757642:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787602523.757645:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602523.757667:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853657856:0@lo:400:kworker.0 00000100:00100000:3.0:1787602523.757674:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853657984:0@lo:400:kworker.0 00000100:00100000:2.0:1787602523.757732:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853657472 00000100:00100000:2.0:1787602523.757736:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853657472 00000100:00100000:2.0:1787602523.757775:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787602523.757780:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3304:x1874436853657472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602523.757809:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3304:x1874436853657472:12345-0@lo:400:kworker.0 Request processed in 30us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602523.757813:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787602523.758095:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853657600:0@lo:400:kworker.0 00000100:00100000:0.0:1787602523.758127:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602523.758153:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853658112:0@lo:400:kworker.0 00000100:00100000:0.0:1787602523.758173:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602523.758199:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787602523.758205:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874436853657728:0@lo:400:kworker.0 00000100:00100000:0.0:1787602523.758228:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602523.758260:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853657600 00000100:00100000:0.0:1787602523.758264:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853657600 00000100:00100000:0.0:1787602523.758281:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853657728 00000100:00100000:0.0:1787602523.758282:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853657728 00000100:00100000:0.0:1787602523.758295:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787602523.758299:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853657600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602523.758324:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853657600:12345-0@lo:400:kworker.0 Request processed in 24us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602523.758336:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787602523.758344:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787602523.758348:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874436853657728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602523.758376:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874436853657728:12345-0@lo:400:kworker.0 Request processed in 28us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602523.758380:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787602523.758397:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874436853657728:0@lo:400:kworker.0 00000100:00100000:0.0:1787602523.758403:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853657600:0@lo:400:kworker.0 00000100:00100000:1.0:1787602523.758477:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853658112 00000100:00100000:1.0:1787602523.758480:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853658112 00000100:00100000:1.0:1787602523.758510:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787602523.758516:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853658112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602523.758558:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853658112:12345-0@lo:400:kworker.0 Request processed in 42us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602523.758565:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1787602523.758682:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787602523.758685:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602523.758699:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853657472:0@lo:400:kworker.0 00010000:00080000:0.0:1787602523.758818:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d647b80 x1874436853658112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602523.758826:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853658112:0@lo:400:kworker.0 00010000:00010000:0.0:1787602523.821606:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602524.269298:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853658240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602524.269400:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602524.269606:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853658240 00000100:00100000:3.0:1787602524.269618:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853658240 00000100:00100000:3.0:1787602524.269727:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787602524.269740:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853658240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602524.269835:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602524.269903:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853658240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602524.269912:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1787602524.269998:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d34074ca300 x1874436853658240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602524.270030:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853658240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602524.379626:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602524.379686:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602524.379899:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833698432 00000100:00100000:0.0:1787602524.379913:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833698432 00000100:00100000:0.0:1787602524.380048:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 124 00000100:00100000:0.0:1787602524.380061:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833698432:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602524.380188:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833698432:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 130us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602524.380196:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 124 00000100:00100000:3.0:1787602524.380841:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833698304 00000100:00100000:3.0:1787602524.380867:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833698304 00000100:00100000:3.0:1787602524.380917:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 282 00000100:00100000:3.0:1787602524.380925:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833698304:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602524.380986:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833698304:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 61us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602524.380993:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 282 00000100:00080000:1.0:1787602524.381835:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602524.384725:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602524.384824:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602524.384992:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833698688 00000100:00100000:2.0:1787602524.385016:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833698688 00000100:00100000:2.0:1787602524.385122:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 125 00000100:00100000:2.0:1787602524.385135:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833698688:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602524.385240:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833698688:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 107us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602524.385248:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 125 00000100:00100000:3.0:1787602524.385952:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833698560 00000100:00100000:3.0:1787602524.385961:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833698560 00000100:00100000:3.0:1787602524.386027:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:3.0:1787602524.386039:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2350:x1874436833698560:12345-192.168.201.26@tcp:9:kworker.0 00000020:00000080:3.0:1787602524.386070:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db376 00000100:00080000:3.0:1787602524.386092:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8d3502f38800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787602524.386143:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1787602524.386538:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602524.386968:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+2:2350:x1874436833698560:12345-192.168.201.26@tcp:9:kworker.0 Request processed in 928us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602524.386978:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00080000:1.0:1787602524.387862:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602524.387872:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787602524.845512:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602525.869339:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602526.317194:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853658368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602526.317279:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602526.317324:0:10486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853658368 00000100:00100000:3.0:1787602526.317333:0:10486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853658368 00000100:00100000:3.0:1787602526.317504:0:10486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787602526.317514:0:10486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853658368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602526.317550:0:10486:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602526.317608:0:10486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853658368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602526.317616:0:10486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787602526.318361:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853658368:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787602526.323202:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787602526.893518:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787602527.448200:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e3aefeab-67b4-4a0a-9090-6916c4553638 00000020:00000080:2.0:1787602527.448211:0:6714:0:(genops.c:885:class_export_put()) final put ffff8d3502f3e800/e3aefeab-67b4-4a0a-9090-6916c4553638 00000020:00000080:0.0:1787602527.448354:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3502f3e800/e3aefeab-67b4-4a0a-9090-6916c4553638 for lustre-OST0000 00000020:00000080:0.0:1787602527.448413:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3502f38800 for lustre-OST0000 00010000:00010000:2.0:1787602527.918308:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602528.885251:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853658496:0@lo:400:kworker.0 00000100:00100000:3.0:1787602528.885365:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602528.885438:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853659008:0@lo:400:kworker.0 00000100:00100000:3.0:1787602528.885468:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602528.885498:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602528.885503:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853658880:0@lo:400:kworker.0 00000100:00100000:3.0:1787602528.885530:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602528.885567:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853658496 00000100:00100000:3.0:1787602528.885577:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853658496 00000100:00100000:3.0:1787602528.885635:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787602528.885645:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3304:x1874436853658496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602528.885701:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3304:x1874436853658496:12345-0@lo:400:kworker.0 Request processed in 56us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602528.885709:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787602528.885771:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853659008 00000100:00100000:3.0:1787602528.885775:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853659008 00000100:00100000:3.0:1787602528.885814:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787602528.885820:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853659008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602528.885853:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853659008:12345-0@lo:400:kworker.0 Request processed in 33us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602528.885859:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787602528.885899:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853658496:0@lo:400:kworker.0 00000100:00100000:3.0:1787602528.885914:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853659008:0@lo:400:kworker.0 00000100:00100000:2.0:1787602528.886130:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853658752:0@lo:400:kworker.0 00000100:00100000:2.0:1787602528.886169:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602528.886205:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787602528.886211:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853658624:0@lo:400:kworker.0 00000100:00100000:2.0:1787602528.886236:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602528.886255:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853659136:0@lo:400:kworker.0 00000100:00100000:2.0:1787602528.886276:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787602528.886324:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602528.886338:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853658752 00000100:00100000:2.0:1787602528.886341:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853658752 00000100:00100000:2.0:1787602528.886372:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853658624 00000100:00100000:2.0:1787602528.886375:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853658624 00000100:00100000:2.0:1787602528.886389:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787602528.886395:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853658752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602528.886432:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853658752:12345-0@lo:400:kworker.0 Request processed in 36us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602528.886438:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787602528.886451:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787602528.886457:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853658624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602528.886482:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853658624:12345-0@lo:400:kworker.0 Request processed in 26us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602528.886488:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787602528.886511:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853658880 00000100:00100000:2.0:1787602528.886515:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853658880 00000100:00100000:2.0:1787602528.886539:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853659136 00000100:00100000:2.0:1787602528.886541:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853659136 00000100:00100000:2.0:1787602528.886561:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787602528.886568:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853658880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602528.886602:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853658880:12345-0@lo:400:kworker.0 Request processed in 35us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602528.886609:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787602528.886619:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787602528.886626:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853659136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602528.886652:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853659136:12345-0@lo:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602528.886667:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787602528.886683:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787602528.886686:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787602528.886688:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602528.886707:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853658624:0@lo:400:kworker.0 00010000:00080000:2.0:1787602528.886720:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d21b100 x1874436853659136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602528.886730:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853659136:0@lo:400:kworker.0 00000100:00100000:2.0:1787602528.886739:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853658752:0@lo:400:kworker.0 00000100:00100000:2.0:1787602528.886804:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853658880:0@lo:400:kworker.0 00010000:00010000:0.0:1787602528.940981:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602529.392178:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602529.402525:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853659264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602529.403184:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602529.405687:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853659264 00000100:00100000:3.0:1787602529.405705:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853659264 00000100:00100000:3.0:1787602529.405917:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787602529.405939:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853659264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602529.405993:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602529.406117:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853659264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (2934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602529.406126:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1787602529.406202:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d350c836680 x1874436853659264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602529.406225:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853659264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602529.493014:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602529.493064:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602529.493104:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602529.493138:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833698944 00000100:00100000:3.0:1787602529.493139:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833698816 00000100:00100000:1.0:1787602529.493152:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833698944 00000100:00100000:3.0:1787602529.493203:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833698816 00000100:00100000:1.0:1787602529.493228:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833699072 00000100:00100000:1.0:1787602529.493231:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833699072 00000100:00100000:1.0:1787602529.493255:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 129 00000100:00100000:1.0:1787602529.493267:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2352:x1874436833698944:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602529.493368:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 284 00000100:00100000:1.0:1787602529.493378:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2352:x1874436833698944:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 113us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602529.493380:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2352:x1874436833698816:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602529.493387:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 129 00000100:00100000:1.0:1787602529.493405:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 130 00000100:00100000:3.0:1787602529.493408:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2352:x1874436833698816:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 32us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602529.493411:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833699072:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602529.493414:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 284 00000100:00100000:1.0:1787602529.493434:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833699072:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 23us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602529.493440:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 130 00000100:00080000:1.0:1787602529.493456:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787602529.971186:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602530.996941:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602531.438104:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787602531.438151:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853659392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602531.438254:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602531.442920:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853659392 00000100:00100000:0.0:1787602531.442944:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853659392 00000100:00100000:0.0:1787602531.443327:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787602531.443341:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853659392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602531.443394:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602531.443513:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853659392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (5259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602531.443521:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787602531.443736:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853659392:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787602531.443948:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787602531.565824:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787602532.013940:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787602532.877542:0:11845:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 16:15:31 (1787602531) 00010000:00010000:0.0:1787602533.040422:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602533.997290:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853659776:0@lo:400:kworker.0 00000100:00100000:1.0:1787602533.997615:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853659904:0@lo:400:kworker.0 00000100:00100000:1.0:1787602533.997725:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602533.997875:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787602533.997883:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853659520:0@lo:400:kworker.0 00000100:00100000:1.0:1787602533.997940:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602533.997972:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853660032:0@lo:400:kworker.0 00000100:00100000:1.0:1787602533.998025:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602533.998070:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853659904 00000100:00100000:1.0:1787602533.998079:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853659904 00000100:00100000:1.0:1787602533.998157:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787602533.998169:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853659904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602533.998239:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853659904:12345-0@lo:400:kworker.0 Request processed in 72us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602533.998247:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787602533.998278:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853660032 00000100:00100000:1.0:1787602533.998282:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853660032 00000100:00100000:1.0:1787602533.998314:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787602533.998322:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d01bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853660032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602533.998588:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d01bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853660032:12345-0@lo:400:kworker.0 Request processed in 266us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602533.998596:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1787602533.998618:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787602533.998624:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602533.998675:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853660032:0@lo:400:kworker.0 00000100:00100000:1.0:1787602533.998689:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853659904:0@lo:400:kworker.0 00000100:00100000:1.0:1787602533.998773:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853659520 00000100:00100000:1.0:1787602533.998778:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853659520 00000100:00100000:1.0:1787602533.998823:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787602533.998829:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853659520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602533.998880:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853659520:12345-0@lo:400:kworker.0 Request processed in 51us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602533.998887:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787602533.999159:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853659648:0@lo:400:kworker.0 00000100:00100000:0.0:1787602533.999204:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602533.999237:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d102300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853660160:0@lo:400:kworker.0 00000100:00100000:0.0:1787602533.999266:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602533.999307:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853659648 00000100:00100000:0.0:1787602533.999311:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853659648 00000100:00100000:0.0:1787602533.999356:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787602533.999364:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853659648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602533.999405:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853659648:12345-0@lo:400:kworker.0 Request processed in 42us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602533.999412:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787602533.999432:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853660160 00000100:00100000:0.0:1787602533.999436:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853660160 00000100:00100000:0.0:1787602533.999484:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787602533.999491:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853660160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602533.999527:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853660160:12345-0@lo:400:kworker.0 Request processed in 37us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602533.999533:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1787602533.999573:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787602533.999599:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853659648:0@lo:400:kworker.0 00010000:00080000:0.0:1787602533.999614:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d102300 x1874436853660160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787602549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602533.999625:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d102300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853660160:0@lo:400:kworker.0 00000100:00100000:3.0:1787602533.999853:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602533.999913:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853659776 00000100:00100000:3.0:1787602533.999928:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853659776 00000100:00100000:3.0:1787602533.999971:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787602533.999978:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853659776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602534.000015:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853659776:12345-0@lo:400:kworker.0 Request processed in 37us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602534.000022:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787602534.000073:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853659776:0@lo:400:kworker.0 00000100:00080000:0.0:1787602534.007310:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602534.013431:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853659520:0@lo:400:kworker.0 00010000:00010000:3.0:1787602534.061211:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602534.510063:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787602534.510098:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853660288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602534.510204:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602534.510816:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853660288 00000100:00100000:1.0:1787602534.510831:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853660288 00000100:00100000:1.0:1787602534.510929:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787602534.510942:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853660288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602534.511003:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602534.511092:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853660288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602534.511100:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1787602534.511506:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d018e00 x1874436853660288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602550 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787602534.511532:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d018e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853660288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602534.544385:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602534.544571:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833699200 00000100:00100000:1.0:1787602534.544588:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833699200 00000100:00100000:1.0:1787602534.544693:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00100000:1.0:1787602534.544709:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:10228:x1874436833699200:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602534.544736:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602534.544798:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09db441 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c238d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602534.544897:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db448 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602534.544914:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602534.544966:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602534.545447:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787602534.545453:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602534.545566:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db448 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602534.545603:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09db441 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c238d expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602534.545629:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db448 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c238d expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602534.545639:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:1.0:1787602534.545643:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602534.545647:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354ea600, rc 0) 00000100:00100000:1.0:1787602534.545879:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:10228:x1874436833699200:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 1172us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602534.545889:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00080000:0.0:1787602534.546103:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602534.555615:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602534.555723:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833699328 00000100:00100000:3.0:1787602534.555737:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833699328 00000100:00100000:2.0:1787602534.556118:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:2.0:1787602534.556134:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:10229:x1874436833699328:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602534.556162:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602534.556193:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09db44f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2394 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.556308:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09db456 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.556327:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09db456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.556342:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09db456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.556360:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09db45d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.556367:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09db45d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.556376:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09db45d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.556928:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4400/0x3640686da09db464 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.556942:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4400/0x3640686da09db464 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.556950:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4400/0x3640686da09db464 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602534.557052:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787602534.557058:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602534.557152:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4400/0x3640686da09db464 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557177:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09db456 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557185:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09db456 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557193:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09db456 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557200:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602534.557205:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09db456 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557214:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09db456 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557230:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:2.0:1787602534.557234:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602534.557239:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09db456 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557246:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09db456 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557261:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09db45d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557268:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09db45d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557275:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09db45d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557287:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602534.557291:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09db45d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557296:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09db45d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557305:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d3504d95400) 00010000:00010000:2.0:1787602534.557307:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602534.557310:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09db45d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557316:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09db45d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557359:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09db44f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2394 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557374:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4400/0x3640686da09db464 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2394 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602534.557382:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d3504d95900) 00010000:00010000:2.0:1787602534.557385:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787602534.557387:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4400, rc 0) 00000100:00100000:2.0:1787602534.557494:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+7:10229:x1874436833699328:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 1361us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602534.557504:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:1.0:1787602534.564431:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602534.565257:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833699584 00000100:00100000:0.0:1787602534.565274:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833699584 00000100:00100000:0.0:1787602534.565364:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 34 00000100:00100000:0.0:1787602534.565377:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:10229:x1874436833699584:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602534.565408:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602534.565441:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db46b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c239b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.565553:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db472 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.565571:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db472 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.565584:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db472 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.571326:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db479 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.571354:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db479 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.571367:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db479 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.572573:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db480 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.572591:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db480 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.572600:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db480 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602534.572613:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787602534.574925:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db472 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.574942:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db472 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.574965:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db472 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.574972:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a5400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602534.574978:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db472 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.574988:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db472 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.575008:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d3504d95900) 00010000:00010000:0.0:1787602534.575012:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602534.575017:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db472 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.575025:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db472 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.575044:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db479 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.575050:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db479 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.575055:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db479 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.575060:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a4c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602534.575063:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db479 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.575078:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db479 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.575087:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d350b502100) 00010000:00010000:0.0:1787602534.575089:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602534.575092:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db479 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.575097:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db479 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.575600:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db46b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c239b expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.575620:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db480 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c239b expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602534.575627:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d350b502400) 00010000:00010000:0.0:1787602534.578484:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602534.578503:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35110a4600, rc 0) 00000100:00100000:0.0:1787602534.578612:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+9:10229:x1874436833699584:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 13231us (14190us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787602534.578623:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 34 00000100:00100000:0.0:1787602534.583128:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602534.586580:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833699712 00000100:00100000:1.0:1787602534.586602:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833699712 00000100:00100000:1.0:1787602534.586714:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:1.0:1787602534.586728:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+9:10229:x1874436833699712:12345-192.168.201.26@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787602534.586997:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+9:10229:x1874436833699712:12345-192.168.201.26@tcp:59:lhsmtool_posix.0 Request processed in 271us (3892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602534.587025:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:1.0:1787602534.615998:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602534.616120:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833699968 00000100:00100000:2.0:1787602534.616153:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833699968 00000100:00100000:2.0:1787602534.616260:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 134 00000100:00100000:2.0:1787602534.616274:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2354:x1874436833699968:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602534.616384:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2354:x1874436833699968:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 114us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602534.616393:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 134 00000100:00080000:0.0:1787602534.616508:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602534.616521:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602534.616551:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833699840 00000100:00100000:3.0:1787602534.616564:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833699840 00000100:00100000:3.0:1787602534.616670:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 286 00000100:00100000:3.0:1787602534.616680:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833699840:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602534.616715:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833699840:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 38us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602534.616723:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 286 00000040:00080000:3.0:1787602534.639185:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787602535.098263:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602536.120872:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602536.559262:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853660416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602536.559376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602536.559548:0:10486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853660416 00000100:00100000:3.0:1787602536.559560:0:10486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853660416 00000100:00100000:3.0:1787602536.559656:0:10486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787602536.559669:0:10486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853660416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602536.559722:0:10486:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602536.559814:0:10486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853660416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602536.559822:0:10486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787602536.560223:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602536.560270:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853660416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787602537.140152:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602537.204110:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602537.204230:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833700096 00000100:00100000:3.0:1787602537.204244:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833700096 00000100:00100000:3.0:1787602537.204345:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:3.0:1787602537.204359:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+9:10271:x1874436833700096:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602537.204386:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602537.204414:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db48e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c23a2 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.204498:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db495 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.204514:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db495 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.204539:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db495 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.204557:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db49c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.204565:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db49c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.204572:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db49c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.204930:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db495 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.204940:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db495 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.204948:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db495 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.204955:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602537.204961:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db495 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.204970:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db495 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.204985:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:3.0:1787602537.204988:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602537.204994:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db495 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.205008:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db495 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.205021:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db49c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.205028:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db49c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.205035:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db49c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.205040:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602537.205044:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db49c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.205050:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db49c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.205057:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d3529dc7600) 00010000:00010000:3.0:1787602537.205059:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602537.205061:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db49c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.205067:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db49c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.205105:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db48e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23a2 expref: 10 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.205128:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:3.0:1787602537.205131:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602537.205136:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db48e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23a2 expref: 10 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.205146:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432600, rc 0) 00000100:00100000:3.0:1787602537.205226:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+9:10271:x1874436833700096:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 870us (1131us total) trans 0 rc 301/301 00000100:00100000:3.0:1787602537.205235:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00080000:1.0:1787602537.205491:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602537.210982:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602537.212009:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833700352 00000100:00100000:1.0:1787602537.212027:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833700352 00000100:00100000:1.0:1787602537.212115:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 37 00000100:00100000:1.0:1787602537.212127:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+9:10271:x1874436833700352:12345-192.168.201.26@tcp:36:lfs.0 00010000:00010000:1.0:1787602537.212206:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602537.212243:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db448 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c238d expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.212266:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:1.0:1787602537.212280:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602537.212643:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.212660:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.212670:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.212682:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db4aa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.212688:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db4aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.212708:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db4aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602537.218219:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787602537.218245:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.218257:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4a3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.218265:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.218270:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eac00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602537.218276:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.218284:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.218307:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350cd81200) 00010000:00010000:1.0:1787602537.218311:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602537.218316:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4a3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.218322:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4a3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602537.218347:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f89fa25c reply state 000000009db26934 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db4aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602537.218371:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787602537.218541:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+10:10271:x1874436833700352:12345-192.168.201.26@tcp:36:lfs.0 Request processed in 6408us (7562us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787602537.218551:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 37 00010000:00010000:2.0:1787602537.227821:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db4aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.227848:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db4aa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.227857:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db4aa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.227865:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eb400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602537.227870:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db4aa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.227876:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db4aa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.227896:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d350cd81300) 00010000:00010000:2.0:1787602537.227899:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602537.227902:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db4aa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.227928:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db4aa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602537.307366:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602537.316634:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833700480 00000100:00100000:3.0:1787602537.316653:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833700480 00000100:00100000:3.0:1787602537.316771:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 38 00000100:00100000:3.0:1787602537.316785:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+9:10279:x1874436833700480:12345-192.168.201.26@tcp:101:lctl.0 00010000:00010000:3.0:1787602537.316825:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602537.316857:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db4b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c23a9 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.316950:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db4b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.316967:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.316980:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602537.321613:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787602537.321651:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602537.321756:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.321826:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db4b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23a9 expref: 11 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.321846:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db4b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23a9 expref: 10 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.321857:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:3.0:1787602537.321861:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602537.321865:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433800, rc 0) 00000100:00100000:3.0:1787602537.321975:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+10:10279:x1874436833700480:12345-192.168.201.26@tcp:101:lctl.0 Request processed in 5190us (14615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602537.321986:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 38 00000100:00100000:0.0:1787602537.416540:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602537.416805:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833700608 00000100:00100000:1.0:1787602537.416819:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833700608 00000100:00100000:1.0:1787602537.416889:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:1.0:1787602537.416902:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+10:10285:x1874436833700608:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787602537.416930:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602537.416960:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c23b0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417063:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db4c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417084:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db4c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417097:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db4c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417116:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417124:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417131:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417302:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb000/0x3640686da09db4d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417312:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb000/0x3640686da09db4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417320:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb000/0x3640686da09db4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602537.417361:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787602537.417366:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602537.417425:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb000/0x3640686da09db4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417440:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db4c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417447:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db4c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417455:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db4c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417461:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602537.417466:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db4c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417474:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db4c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417489:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:1.0:1787602537.417499:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602537.417505:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db4c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417512:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db4c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417528:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417534:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417541:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417546:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602537.417549:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417555:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417562:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d350cd81200) 00010000:00010000:1.0:1787602537.417564:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602537.417567:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417574:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417612:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23b0 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417641:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb000/0x3640686da09db4d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23b0 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.417650:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:1.0:1787602537.417653:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787602537.417656:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eb000, rc 0) 00000100:00100000:1.0:1787602537.417807:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+11:10285:x1874436833700608:12345-192.168.201.26@tcp:101:bash.0 Request processed in 904us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602537.417815:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:2.0:1787602537.422433:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602537.422553:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833700864 00000100:00100000:0.0:1787602537.422567:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833700864 00000100:00100000:0.0:1787602537.422705:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:0.0:1787602537.422718:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+11:10285:x1874436833700864:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:0.0:1787602537.422781:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602537.422823:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09db4db lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c23b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.423013:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db4e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.423043:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db4e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.423057:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db4e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.430925:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.430959:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.430976:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787602537.432724:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787602537.433318:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.433338:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.433352:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.433408:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db4e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.433428:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db4e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.433436:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db4e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.433443:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a5400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602537.433448:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db4e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.433456:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db4e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.433472:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:1.0:1787602537.433475:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602537.433481:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db4e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.433487:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db4e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602537.433509:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000373ff03e reply state 0000000081952186 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602537.433521:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787602537.433569:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09db4db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23b7 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.433588:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23b7 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.433609:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81300) 00010000:00010000:1.0:1787602537.433612:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602537.433614:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354ea200, rc 0) 00000100:00100000:1.0:1787602537.433715:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+14:10285:x1874436833700864:12345-192.168.201.26@tcp:101:bash.0 Request processed in 10998us (11295us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787602537.433726:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 40 00010000:00010000:1.0:1787602537.440429:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.440456:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.440465:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.440473:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eac00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602537.440479:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.440487:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.440512:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d350cd81200) 00010000:00010000:1.0:1787602537.440515:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602537.440521:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.440528:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db4e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602537.443681:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602537.444350:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833700992 00000100:00100000:1.0:1787602537.444365:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833700992 00000100:00100000:1.0:1787602537.444436:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:1.0:1787602537.444447:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1874436833700992:12345-192.168.201.26@tcp:8:bash.0 00010000:00080000:1.0:1787602537.444492:0:6689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:1.0:1787602537.444539:0:6689:0:(genops.c:1385:class_connect()) connect: client e3aefeab-67b4-4a0a-9090-6916c4553638, cookie 0x3640686da09db4fe 00002000:00100000:1.0:1787602537.444556:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e3aefeab-67b4-4a0a-9090-6916c4553638/ffff8d3534d8d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787602537.444590:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787602537.444966:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787602537.445008:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8d353d25f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602537.445093:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2350:x1874436833700992:12345-192.168.201.26@tcp:8:bash.0 Request processed in 645us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602537.445102:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:0.0:1787602537.449150:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602537.449337:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833701120 00000100:00100000:2.0:1787602537.449350:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833701120 00000100:00100000:2.0:1787602537.449439:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:2.0:1787602537.449453:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:0:x1874436833701120:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787602537.449479:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602537.449513:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d8dae70/0x3640686da09db505 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c23be expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787602537.449551:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602537.449576:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=322s v=(0 0) 00010000:00010000:2.0:1787602537.449582:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602537.449594:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d8dae70/0x3640686da09db505 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23be expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.449617:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005d8dae70/0x3640686da09db505 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23be expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.449634:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4e00, rc 0) 00000100:00100000:2.0:1787602537.449714:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:0:x1874436833701120:12345-192.168.201.26@tcp:101:bash.0 Request processed in 264us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602537.449723:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00080000:1.0:1787602537.449996:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787602537.455971:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602537.456187:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833701248 00000100:00100000:1.0:1787602537.456201:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833701248 00000100:00100000:1.0:1787602537.456288:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:1.0:1787602537.456301:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+7:10285:x1874436833701248:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787602537.456326:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602537.456359:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c23c5 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.456401:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d8dae70/0x3640686da09db505 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23be expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.456435:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602537.456440:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602537.456447:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23c5 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.456494:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d8dae70/0x3640686da09db505 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23be expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.456510:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d8dae70/0x3640686da09db505 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23be expref: 8 pid: 6691 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602537.456530:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d01ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1874436853660544:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602537.456656:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503365c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787602537.461101:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602537.461174:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833701376 00000100:00100000:2.0:1787602537.461186:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833701376 00010000:00010000:2.0:1787602537.461244:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d8dae70/0x3640686da09db505 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23be expref: 9 pid: 6691 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602537.461309:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:2.0:1787602537.461323:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d101f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+9:2351:x1874436833701376:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602537.461344:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602537.461376:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d8dae70/0x3640686da09db505 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23be expref: 9 pid: 6691 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.461393:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d8dae70/0x3640686da09db505 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23be expref: 9 pid: 6691 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.461426:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602537.461432:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602537.461441:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23c5 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.461452:0:11167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23c5 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.461505:0:11167:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23c5 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602537.461523:0:11167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d647800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11167:1874436853660672:192.168.201.26@tcp:105: 00000100:00100000:2.0:1787602537.461658:0:11167:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353ca93480 going to sleep for 11 seconds 00010000:00010000:1.0:1787602537.462638:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d8dae70/0x3640686da09db505 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23be expref: 9 pid: 6691 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602537.462662:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d01ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1874436853660544:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602537.462693:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23c5 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602537.462709:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eac00, rc 0) 00000100:00100000:1.0:1787602537.463149:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+8:10285:x1874436833701248:12345-192.168.201.26@tcp:101:bash.0 Request processed in 6838us (7182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602537.463183:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:2.0:1787602537.465328:0:11167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d647800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11167:1874436853660672:192.168.201.26@tcp:105: 00010000:00010000:2.0:1787602537.465365:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602537.465439:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d101f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833701376:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 4117us (4366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602537.465451:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:0.0:1787602537.468318:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602537.468493:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833701632 00000100:00100000:1.0:1787602537.468508:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833701632 00000100:00100000:1.0:1787602537.468635:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:1.0:1787602537.468649:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+13:10285:x1874436833701632:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:2.0:1787602537.470096:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+14:10285:x1874436833701632:12345-192.168.201.26@tcp:35:bash.0 Request processed in 1440us (1782us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787602537.470114:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:1.0:1787602537.539669:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602537.540206:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833701888 00000100:00100000:0.0:1787602537.540220:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833701888 00000100:00100000:0.0:1787602537.540337:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 41 00000100:00100000:0.0:1787602537.540351:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d01ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+14:10295:x1874436833701888:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602537.540385:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602537.540415:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db513 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c23cc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602537.540599:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787602537.540818:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db513 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23cc expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.540837:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:0.0:1787602537.540841:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602537.540847:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db513 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23cc expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.540865:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35110a4c00, rc 0) 00000100:00100000:0.0:1787602537.540952:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d01ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+15:10295:x1874436833701888:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 604us (1298us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1787602537.540960:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 41 00000100:00100000:2.0:1787602537.546526:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602537.547540:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833702144 00000100:00100000:0.0:1787602537.547556:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833702144 00000100:00100000:0.0:1787602537.547820:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:0.0:1787602537.547834:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+15:10295:x1874436833702144:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:0.0:1787602537.548448:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+16:10295:x1874436833702144:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 614us (1935us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787602537.548458:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:1.0:1787602537.639533:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602537.639624:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833702272 00000100:00100000:3.0:1787602537.639640:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833702272 00000100:00100000:3.0:1787602537.639718:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 42 00000100:00100000:3.0:1787602537.639730:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d01a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+16:10301:x1874436833702272:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602537.639812:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602537.639840:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db521 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c23d3 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.639950:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db528 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.639967:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.639995:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602537.640574:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787602537.640580:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602537.640667:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.640707:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23d3 expref: 18 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.640727:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db528 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23d3 expref: 17 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.640737:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:3.0:1787602537.640766:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602537.640772:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433200, rc 0) 00000100:00100000:3.0:1787602537.641076:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d01a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+17:10301:x1874436833702272:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1346us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602537.641085:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 42 00000100:00100000:1.0:1787602537.644582:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602537.644668:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833702528 00000100:00100000:3.0:1787602537.644682:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833702528 00000100:00100000:3.0:1787602537.644863:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:3.0:1787602537.644877:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+17:10301:x1874436833702528:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602537.644903:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602537.644933:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db52f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c23da expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.645091:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db536 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.645362:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.645379:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602537.645395:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787602537.645692:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db52f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23da expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.645713:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db536 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23da expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.645723:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81300) 00010000:00010000:3.0:1787602537.645727:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602537.645731:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432e00, rc 0) 00000100:00100000:3.0:1787602537.645980:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+19:10301:x1874436833702528:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1104us (1410us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787602537.645990:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:3.0:1787602537.650353:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602537.650508:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833702784 00000100:00100000:3.0:1787602537.650522:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833702784 00000100:00100000:3.0:1787602537.650591:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:3.0:1787602537.650603:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+19:10301:x1874436833702784:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602537.650658:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602537.650687:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db544 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c23e1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.650863:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db54b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.650881:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db54b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.650895:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db54b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602537.650911:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787602537.651075:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db544 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23e1 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.651095:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db54b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23e1 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.651492:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81300) 00010000:00010000:3.0:1787602537.651498:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787602537.651504:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433c00, rc 0) 00000100:00100000:3.0:1787602537.651641:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+21:10301:x1874436833702784:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1037us (1299us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787602537.651651:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:0.0:1787602537.657527:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602537.658669:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833702912 00000100:00100000:3.0:1787602537.658688:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833702912 00000100:00100000:3.0:1787602537.658800:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:3.0:1787602537.658828:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+21:2352:x1874436833702912:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602537.658860:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602537.658895:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db536 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23da expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.658918:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81300) 00010000:00010000:3.0:1787602537.658924:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602537.658996:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+20:2352:x1874436833702912:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 173us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602537.659005:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:3.0:1787602537.663467:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602537.663512:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833703040 00000100:00100000:3.0:1787602537.663524:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833703040 00000100:00100000:3.0:1787602537.663583:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:3.0:1787602537.663595:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d100a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2353:x1874436833703040:12345-192.168.201.26@tcp:1:lfs.0 00010000:00010000:3.0:1787602537.663655:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eb1297c/0x3640686da09db559 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.663680:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23c5 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.663691:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602537.663696:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787602537.663702:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eb1297c/0x3640686da09db559 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.663774:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23c5 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.663834:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23c5 expref: 7 pid: 6689 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602537.664125:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d102300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1874436853660800:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787602537.664243:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948d80 going to sleep for 11 seconds 00000001:00080000:1.0:1787602537.672011:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967314 is committed 00000100:00100000:3.0:1787602537.672386:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602537.672486:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d102300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1874436853660800:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787602537.672516:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833703168 00010000:00010000:3.0:1787602537.672519:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003eb1297c/0x3640686da09db559 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602537.672531:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833703168 00002000:00100000:0.0:1787602537.672610:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8d353d265180 x1874436833703168/t0(0) o4->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:373/0 lens 504/0 e 0 to 0 dl 1787602548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787602537.672638:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d353d265180 with x1874436833703168 ext(0->12) 00010000:00010000:0.0:1787602537.672648:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23c5 expref: 8 pid: 6689 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.672668:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23c5 expref: 8 pid: 6689 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787602537.672675:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d353d265180 00000100:00100000:0.0:1787602537.672716:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:0.0:1787602537.672727:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2351:x1874436833703168:12345-192.168.201.26@tcp:4:lfs.0 00000001:00100000:2.0:1787602537.718883:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e3aefeab-67b4-4a0a-9090-6916c4553638 00000001:00080000:2.0:1787602537.760725:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1787602537.761234:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833703168:12345-192.168.201.26@tcp:4:lfs.0 Request processed in 88502us (88854us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787602537.761253:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00002000:00100000:3.0:1787602537.761267:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8d353d265180 x1874436833703168/t4294967299(0) o4->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:373/0 lens 504/448 e 0 to 0 dl 1787602548 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787602537.761287:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d353d265180 with x1874436833703168 ext(0->12) 00010000:00010000:3.0:1787602537.761299:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23c5 expref: 7 pid: 6689 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.761319:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23c5 expref: 7 pid: 6689 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787602537.761329:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d353d265180 00000100:00100000:3.0:1787602537.763906:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602537.764251:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833703296 00000100:00100000:2.0:1787602537.764261:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833703296 00010000:00010000:2.0:1787602537.764314:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23c5 expref: 7 pid: 6689 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602537.764415:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:2.0:1787602537.764426:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d265c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2352:x1874436833703296:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602537.764443:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787602537.764465:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787602537.764468:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787602538 00002000:00010000:2.0:1787602537.764470:0:5824:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787602538 00002000:00010000:2.0:1787602537.764472:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787602538 00002000:00010000:2.0:1787602537.764475:0:5824:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1787602537.764481:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23c5 expref: 7 pid: 6689 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.764510:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23c5 expref: 7 pid: 6689 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.764537:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09db50c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23c5 expref: 7 pid: 6689 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.764555:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602537.764560:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602537.764566:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003eb1297c/0x3640686da09db559 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.764577:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eb1297c/0x3640686da09db559 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.764613:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602537.764673:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d265c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833703296:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 249us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602537.764681:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 36 00010000:00010000:3.0:1787602537.764740:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003eb1297c/0x3640686da09db559 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.764794:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003eb1297c/0x3640686da09db559 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.764822:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eb1297c/0x3640686da09db559 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.764830:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003eb1297c/0x3640686da09db559 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.764838:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003eb1297c/0x3640686da09db559 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.764846:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432600 already unused, calling callback (ffffffffc1656230) 00010000:00010000:3.0:1787602537.764861:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003eb1297c/0x3640686da09db559 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.764871:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003eb1297c/0x3640686da09db559 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.764886:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003eb1297c/0x3640686da09db559 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.764895:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eb1297c/0x3640686da09db559 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602537.764954:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d100a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2353:x1874436833703040:12345-192.168.201.26@tcp:1:lfs.0 Request processed in 101361us (101503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602537.764964:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:1.0:1787602537.769207:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602537.769417:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833703552 00000100:00100000:2.0:1787602537.769427:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833703552 00000100:00100000:2.0:1787602537.769473:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:2.0:1787602537.769482:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+14:10301:x1874436833703552:12345-192.168.201.26@tcp:35:lfs.0 00000004:00010000:2.0:1787602537.769545:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db54b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23e1 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787602537.771446:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1787602537.771514:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1787602537.772604:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1787602537.772687:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db560 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.772708:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23b7 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.772717:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db560 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.773143:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23b7 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.773160:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23b7 expref: 18 pid: 5837 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602537.773177:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d264a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1874436853660928:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787602537.773348:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3508732a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787602537.776821:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602537.777034:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833703680 00000100:00100000:2.0:1787602537.777056:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833703680 00010000:00010000:2.0:1787602537.777105:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4f0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23b7 expref: 19 pid: 5837 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602537.777145:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 37 00000100:00100000:2.0:1787602537.777154:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+19:2352:x1874436833703680:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602537.777170:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602537.777177:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4f0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23b7 expref: 19 pid: 5837 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.777191:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23b7 expref: 19 pid: 5837 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.777215:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81300) 00010000:00010000:2.0:1787602537.777221:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db560 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.777231:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db560 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.777238:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db560 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.777257:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602537.777319:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+19:2352:x1874436833703680:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 166us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602537.777344:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 37 00010000:00010000:3.0:1787602537.778166:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db4f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23b7 expref: 18 pid: 5837 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602537.778185:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d264a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1874436853660928:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602537.778216:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db560 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.778226:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db560 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.778231:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db560 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787602537.778363:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787602537.778579:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787602537.778682:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d264a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874436853661056:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787602537.778816:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602537.778959:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350855e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787602537.779121:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853661056 00000100:00100000:0.0:1787602537.779129:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853661056 00000100:00100000:0.0:1787602537.779239:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602537.779249:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1874436853661056:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787602537.779341:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1874436853661056:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 93us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602537.779348:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602537.779465:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d264a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874436853661056:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787602537.780186:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787602537.780254:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d646680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874436853661184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787602537.780295:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602537.780327:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353ca93900 going to sleep for 11 seconds 00000100:00100000:0.0:1787602537.780569:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853661184 00000100:00100000:0.0:1787602537.780576:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853661184 00000100:00100000:0.0:1787602537.780617:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602537.780626:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1874436853661184:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787602537.780920:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1874436853661184:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 294us (623us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787602537.780927:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602537.783035:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d646680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874436853661184:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787602537.783350:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1787602537.783413:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db560 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.783426:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db560 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.783435:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db560 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.783442:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602537.783447:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db560 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.783455:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db560 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.783471:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81300) 00010000:00010000:2.0:1787602537.783474:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787602537.783479:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db560 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.783502:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09db560 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787602537.783698:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787602537.784236:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787602537.784248:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 322730504339ns, next at 323730502409ns, rc = 0 00000001:00080000:2.0:1787602537.784256:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787602537.784296:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81300) 00010000:00010000:2.0:1787602537.784300:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787602537.784308:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db54b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23e1 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602537.784481:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+21:10301:x1874436833703552:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 14998us (15283us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787602537.784491:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 8 00000020:00080000:2.0:1787602537.784497:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1787602537.784562:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787602537.788510:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602537.788633:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833703808 00000100:00100000:0.0:1787602537.788645:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833703808 00000100:00100000:0.0:1787602537.788789:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:0.0:1787602537.788802:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+21:10301:x1874436833703808:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602537.788827:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602537.788862:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db567 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c23e8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.788926:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db567 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23e8 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.788942:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db567 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23e8 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.788962:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:0.0:1787602537.788965:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787602537.788969:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35110a4e00, rc 0) 00000100:00100000:0.0:1787602537.789038:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+22:10301:x1874436833703808:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 238us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602537.789054:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:2.0:1787602537.801333:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602537.801424:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833704064 00000100:00100000:0.0:1787602537.801434:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833704064 00000100:00100000:0.0:1787602537.801512:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:0.0:1787602537.801521:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35079d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+22:10301:x1874436833704064:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:0.0:1787602537.801720:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35079d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+23:10301:x1874436833704064:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 200us (398us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1787602537.801726:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:1.0:1787602537.916351:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602537.916446:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833704320 00000100:00100000:3.0:1787602537.916456:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833704320 00000100:00100000:3.0:1787602537.916563:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:3.0:1787602537.916574:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d01b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+23:10311:x1874436833704320:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602537.916600:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602537.916622:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db56e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c23ef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602537.918357:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787602537.918548:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db56e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23ef expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.918564:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:2.0:1787602537.918566:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787602537.918570:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db56e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23ef expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602537.918581:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432600, rc 0) 00000100:00100000:2.0:1787602537.918704:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d01b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+24:10311:x1874436833704320:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 2132us (2362us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1787602537.918712:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:1.0:1787602537.925203:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602537.925346:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833704448 00000100:00100000:3.0:1787602537.925358:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833704448 00000100:00100000:3.0:1787602537.925423:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:3.0:1787602537.925436:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d01b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+24:10311:x1874436833704448:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:3.0:1787602537.925524:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db57c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.925558:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db57c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.925570:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db57c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.925592:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db583 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.925599:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.925606:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926470:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db58a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926482:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db58a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926491:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db58a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787602537.926541:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db58a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926555:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db57c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926561:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db57c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926579:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db57c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926585:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602537.926589:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db57c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926596:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db57c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926610:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:3.0:1787602537.926613:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602537.926617:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db57c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926624:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db57c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926637:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926643:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db583 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926649:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db583 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926653:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602537.926657:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db583 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926672:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db583 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926681:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3529dc7000) 00010000:00010000:3.0:1787602537.926683:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602537.926686:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db583 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926692:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db583 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926706:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db58a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926712:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db58a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926718:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db58a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926723:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602537.926726:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db58a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926731:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db58a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.926737:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:3.0:1787602537.926739:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602537.928071:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db58a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602537.928170:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db58a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602537.928370:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d01b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+24:10311:x1874436833704448:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 2931us (3173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602537.928380:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:3.0:1787602537.933159:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602537.939583:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833704704 00000100:00100000:2.0:1787602537.939606:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833704704 00000100:00100000:2.0:1787602537.939710:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:2.0:1787602537.939724:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+24:10311:x1874436833704704:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:2.0:1787602537.940816:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+25:10311:x1874436833704704:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 1087us (7660us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787602537.940825:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:1.0:1787602537.997697:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602537.997968:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833704960 00000100:00100000:0.0:1787602537.997979:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833704960 00000100:00100000:0.0:1787602537.998044:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:0.0:1787602537.998056:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+25:10314:x1874436833704960:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602537.998084:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602537.998123:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09db591 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c23f6 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.998212:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db598 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.998227:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db598 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.998239:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db598 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.998257:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db59f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.998264:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db59f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.998271:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db59f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.998653:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09db5a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.998665:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09db5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602537.998697:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09db5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602537.998710:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787602538.000018:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db598 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.000035:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db598 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.000043:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db598 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.000049:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a5400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602538.000054:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db598 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.000062:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db598 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.000079:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:0.0:1787602538.000082:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602538.000088:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db598 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.000094:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09db598 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.000235:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db59f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.000241:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db59f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.000258:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db59f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.000264:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a4c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602538.000267:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db59f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.000274:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db59f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.000283:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d350b502e00) 00010000:00010000:0.0:1787602538.000285:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602538.000288:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db59f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.000293:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09db59f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.000356:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09db591 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23f6 expref: 28 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.000372:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09db5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23f6 expref: 27 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.000380:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:0.0:1787602538.000382:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787602538.000385:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2800, rc 0) 00000100:00100000:0.0:1787602538.000533:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+27:10314:x1874436833704960:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 2479us (2859us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1787602538.000554:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:3.0:1787602538.006149:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602538.006579:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833705088 00000100:00100000:0.0:1787602538.006591:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833705088 00000100:00100000:0.0:1787602538.007083:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:0.0:1787602538.007095:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+27:10314:x1874436833705088:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:0.0:1787602538.007169:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09db5b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.007183:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09db5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.007196:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09db5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.007228:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09db5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.007235:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09db5b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.007243:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09db5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.007250:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602538.007254:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09db5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.007261:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09db5b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.007273:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:0.0:1787602538.007290:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602538.007295:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09db5b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.007302:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09db5b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602538.007376:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+27:10314:x1874436833705088:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 284us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602538.007384:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:3.0:1787602538.012719:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602538.013427:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833705344 00000100:00100000:2.0:1787602538.013440:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833705344 00000100:00100000:2.0:1787602538.013510:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:2.0:1787602538.013522:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+27:10314:x1874436833705344:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:2.0:1787602538.014150:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+28:10314:x1874436833705344:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 628us (1440us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787602538.014158:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00010000:00010000:0.0:1787602538.157523:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602538.429125:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602538.429952:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833705600 00000100:00100000:2.0:1787602538.429964:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833705600 00000100:00100000:2.0:1787602538.430090:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 50 00000100:00100000:2.0:1787602538.430101:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d01a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+28:10345:x1874436833705600:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:2.0:1787602538.430126:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602538.430149:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db5bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c23fd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.430267:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09db5c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.430295:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09db5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.430306:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09db5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602538.430318:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787602538.430482:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db5bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23fd expref: 31 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.430501:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09db5c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23fd expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.430510:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:2.0:1787602538.430513:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602538.430527:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4a00, rc 0) 00000100:00100000:2.0:1787602538.430597:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d01a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+30:10345:x1874436833705600:12345-192.168.201.26@tcp:101:cat.0 Request processed in 497us (1482us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787602538.430603:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 50 00000100:00100000:3.0:1787602538.435164:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602538.435218:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602538.435258:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833705984 00000100:00100000:3.0:1787602538.435267:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833705984 00000100:00100000:3.0:1787602538.435331:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:3.0:1787602538.435341:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3509d56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+30:2352:x1874436833705984:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602538.435356:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602538.435383:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09db5c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23fd expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602538.435403:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:3.0:1787602538.435408:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602538.435466:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3509d56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+29:2352:x1874436833705984:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 126us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602538.435473:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:1.0:1787602538.435622:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833705856 00000100:00100000:1.0:1787602538.435626:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833705856 00000100:00100000:1.0:1787602538.435659:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:1.0:1787602538.435666:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+29:10345:x1874436833705856:12345-192.168.201.26@tcp:35:cat.0 00000100:00100000:1.0:1787602538.438003:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+30:10345:x1874436833705856:12345-192.168.201.26@tcp:35:cat.0 Request processed in 2327us (2841us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787602538.438018:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:3.0:1787602538.543596:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602538.543783:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833706240 00000100:00100000:1.0:1787602538.543794:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833706240 00000100:00100000:1.0:1787602538.543883:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:1.0:1787602538.543893:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+30:10351:x1874436833706240:12345-192.168.201.26@tcp:101:dd.0 00010000:00010000:1.0:1787602538.543919:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602538.543923:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787602538.543948:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db528 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23d3 expref: 30 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.543967:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:1.0:1787602538.543973:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602538.543987:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09db5d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2404 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.544113:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db5d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.544129:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09db5a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23f6 expref: 30 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.544137:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db5d7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.544175:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09db5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23f6 expref: 30 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.544191:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09db5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23f6 expref: 30 pid: 8208 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602538.544207:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d01b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853661312:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602538.544338:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503365900 going to sleep for 11 seconds 00000100:00100000:3.0:1787602538.548596:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602538.548825:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d01b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853661312:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602538.548864:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db5d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602538.549261:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833706368 00000100:00100000:2.0:1787602538.549269:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833706368 00010000:00010000:2.0:1787602538.549315:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09db5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23f6 expref: 31 pid: 8208 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602538.549357:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 38 00000100:00100000:2.0:1787602538.549368:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d265500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+31:2351:x1874436833706368:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602538.549383:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602538.549398:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09db5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23f6 expref: 31 pid: 8208 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.549410:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09db5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23f6 expref: 31 pid: 8208 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.549433:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09db5a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23f6 expref: 31 pid: 8208 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.549453:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:2.0:1787602538.549459:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db5d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.549468:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db5d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.549476:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db5d7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.549507:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602538.549579:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d265500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+30:2351:x1874436833706368:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 213us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602538.549587:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 38 00010000:00010000:3.0:1787602538.550156:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db5d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602538.550164:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db5d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602538.550185:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787602538.550379:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09db5d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2404 expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602538.550396:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db5d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2404 expref: 30 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602538.550404:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:3.0:1787602538.550408:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787602538.550410:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eae00, rc 0) 00000100:00100000:3.0:1787602538.550463:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+30:10351:x1874436833706240:12345-192.168.201.26@tcp:101:dd.0 Request processed in 6571us (6876us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787602538.550470:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:3.0:1787602538.556320:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602538.556473:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833706624 00000100:00100000:0.0:1787602538.556484:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833706624 00000100:00100000:0.0:1787602538.556557:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 52 00000100:00100000:0.0:1787602538.556569:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+30:10351:x1874436833706624:12345-192.168.201.26@tcp:36:dd.0 00010000:00010000:0.0:1787602538.556909:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db5e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.556929:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.556941:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787602538.556996:0:8208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1787602538.557022:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002929dcc2 reply state 000000007a10558f transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602538.557031:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602538.557129:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+33:10351:x1874436833706624:12345-192.168.201.26@tcp:36:dd.0 Request processed in 562us (819us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787602538.557152:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 52 00000020:00080000:0.0:1787602538.557157:0:8208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787602538.560875:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.560894:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db5e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.560901:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db5e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.560926:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e2e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602538.560931:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db5e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.560939:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db5e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.560956:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:2.0:1787602538.560959:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602538.560963:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db5e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602538.560969:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db5e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602538.843425:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602538.845472:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833706752 00000100:00100000:1.0:1787602538.845487:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833706752 00000100:00100000:1.0:1787602538.845628:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:1.0:1787602538.845640:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+32:10366:x1874436833706752:12345-192.168.201.26@tcp:101:stat.0 00010000:00010000:1.0:1787602538.845667:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602538.845690:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09db5ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c240b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.845791:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09db5f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.845805:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09db5f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.845815:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09db5f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.845840:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb800/0x3640686da09db5fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.845848:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb800/0x3640686da09db5fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.845855:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb800/0x3640686da09db5fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.846430:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db601 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.846446:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db5d7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2404 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.846454:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db601 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.846494:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db5d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2404 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.846510:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db5d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2404 expref: 33 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602538.846524:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d01b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874436853661440:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602538.846698:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503365900 going to sleep for 11 seconds 00000100:00100000:1.0:1787602538.853133:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602538.853637:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833707008 00000100:00100000:2.0:1787602538.853648:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833707008 00000100:00100000:2.0:1787602538.853713:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:2.0:1787602538.853724:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d01aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+34:5591:x1874436833707008:12345-192.168.201.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787602538.854158:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d01aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+35:5591:x1874436833707008:12345-192.168.201.26@tcp:35:ldlm_bl.0 Request processed in 435us (1035us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787602538.854167:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:3.0:1787602538.857546:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602538.857657:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833707136 00000100:00100000:1.0:1787602538.857668:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833707136 00010000:00010000:1.0:1787602538.857710:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db5d7 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2404 expref: 35 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602538.857787:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:1.0:1787602538.857798:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d264700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+35:2351:x1874436833707136:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602538.857813:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602538.857821:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db5d7 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2404 expref: 35 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.857859:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db5d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2404 expref: 35 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.857885:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:1.0:1787602538.857891:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db601 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.857902:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.857909:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db601 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.857930:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602538.857988:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d264700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+35:2351:x1874436833707136:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 192us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602538.857996:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 39 00010000:00010000:0.0:1787602538.859955:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db5d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2404 expref: 34 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602538.859980:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d01b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874436853661440:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787602538.860003:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860014:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860020:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602538.860067:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787602538.860071:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602538.860456:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860472:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860482:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09db5f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860488:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09db5f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860494:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09db5f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860513:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602538.860517:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09db5f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860525:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09db5f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860539:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:0.0:1787602538.860542:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602538.860546:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09db5f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860551:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09db5f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860563:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb800/0x3640686da09db5fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860569:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb800/0x3640686da09db5fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860574:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb800/0x3640686da09db5fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860578:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eb800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602538.860581:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb800/0x3640686da09db5fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860587:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb800/0x3640686da09db5fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860603:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d350cd81200) 00010000:00010000:0.0:1787602538.860606:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602538.860609:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb800/0x3640686da09db5fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860614:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb800/0x3640686da09db5fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860660:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09db5ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c240b expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860673:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db601 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c240b expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.860679:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:0.0:1787602538.860681:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787602538.860684:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354ea200, rc 0) 00000100:00100000:0.0:1787602538.860863:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+33:10366:x1874436833706752:12345-192.168.201.26@tcp:101:stat.0 Request processed in 15223us (17447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602538.860871:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:3.0:1787602538.963560:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602538.963723:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833707392 00000100:00100000:0.0:1787602538.963735:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833707392 00000100:00100000:0.0:1787602538.963847:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 54 00000100:00100000:0.0:1787602538.963859:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+33:10372:x1874436833707392:12345-192.168.201.26@tcp:36:truncate.0 00010000:00010000:0.0:1787602538.963925:0:8208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602538.963958:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db601 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c240b expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.964002:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:0.0:1787602538.964008:0:8208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602538.964626:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db608 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.964642:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602538.964652:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787602538.964718:0:8208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1787602538.964802:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9be9191 reply state 00000000436c605d transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602538.964812:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602538.964974:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+35:10372:x1874436833707392:12345-192.168.201.26@tcp:36:truncate.0 Request processed in 1115us (1422us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787602538.964982:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 54 00000020:00080000:0.0:1787602538.964987:0:8208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787602538.971961:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.971981:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db608 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.971988:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db608 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.971995:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602538.972000:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db608 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.972025:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db608 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.972043:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:1.0:1787602538.972046:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602538.972051:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db608 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602538.972058:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db608 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602539.117949:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853661568:0@lo:400:kworker.0 00000100:00100000:0.0:1787602539.118033:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602539.118133:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853661568 00000100:00100000:0.0:1787602539.118142:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853661568 00000100:00100000:0.0:1787602539.118208:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787602539.118229:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d354141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3304:x1874436853661568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602539.118287:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d354141f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3304:x1874436853661568:12345-0@lo:400:kworker.0 Request processed in 69us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602539.118313:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787602539.118365:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853661568:0@lo:400:kworker.0 00000100:00100000:1.0:1787602539.118721:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853661696:0@lo:400:kworker.0 00000100:00100000:1.0:1787602539.118834:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602539.118983:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853661824:0@lo:400:kworker.0 00000100:00100000:3.0:1787602539.119013:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602539.119245:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853661696 00000100:00100000:0.0:1787602539.119251:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853661696 00000100:00100000:0.0:1787602539.119291:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853661824 00000100:00100000:0.0:1787602539.119295:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853661824 00000100:00100000:0.0:1787602539.119326:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787602539.119334:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853661696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602539.122271:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787602539.122302:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853661824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602539.122418:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853661824:12345-0@lo:400:kworker.0 Request processed in 134us (3403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602539.122441:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787602539.122516:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853661824:0@lo:400:kworker.0 00000100:00080000:3.0:1787602539.122598:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602539.132687:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787602539.132714:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853661952:0@lo:400:kworker.0 00000100:00100000:2.0:1787602539.132814:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602539.132879:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853661952 00000100:00100000:2.0:1787602539.132887:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853661952 00000100:00100000:2.0:1787602539.132956:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787602539.132979:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853661952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602539.133032:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853661952:12345-0@lo:400:kworker.0 Request processed in 56us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602539.133039:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1787602539.133061:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602539.133102:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853661952:0@lo:400:kworker.0 00000100:00100000:2.0:1787602539.133140:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853662080:0@lo:400:kworker.0 00000100:00100000:2.0:1787602539.133167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602539.133208:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853662080 00000100:00100000:2.0:1787602539.133212:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853662080 00000100:00100000:2.0:1787602539.133253:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787602539.133260:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853662080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602539.133294:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853662080:12345-0@lo:400:kworker.0 Request processed in 34us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602539.133300:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1787602539.133314:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602539.133329:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853662080:0@lo:400:kworker.0 00000100:00100000:2.0:1787602539.133361:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787602539.133369:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853662208:0@lo:400:kworker.0 00000100:00100000:2.0:1787602539.133393:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602539.133418:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853662208 00000100:00100000:2.0:1787602539.133422:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853662208 00000100:00100000:2.0:1787602539.133448:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787602539.133455:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1874436853662208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602539.133488:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1874436853662208:12345-0@lo:400:kworker.0 Request processed in 33us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602539.133505:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1787602539.133518:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787602539.133535:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853662208:0@lo:400:kworker.0 00000100:00100000:0.0:1787602539.137677:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853661696:12345-0@lo:400:kworker.0 Request processed in 18333us (18841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602539.137691:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787602539.142467:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853661696:0@lo:400:kworker.0 00000100:00100000:3.0:1787602539.164474:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602539.164592:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833707520 00000100:00100000:0.0:1787602539.164603:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833707520 00000100:00100000:0.0:1787602539.164684:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00100000:0.0:1787602539.164694:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+34:10385:x1874436833707520:12345-192.168.201.26@tcp:101:stat.0 00010000:00010000:0.0:1787602539.164719:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602539.164738:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09db60f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2412 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.164864:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db616 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.164879:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db616 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.164892:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db616 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.164929:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09db61d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.164937:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09db61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.164944:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09db61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165397:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3600/0x3640686da09db624 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165406:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3600/0x3640686da09db624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165414:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3600/0x3640686da09db624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602539.165452:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787602539.165457:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602539.165476:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3600/0x3640686da09db624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165488:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3600/0x3640686da09db624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165495:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db616 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165501:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db616 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165518:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db616 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165525:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e2000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602539.165529:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db616 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165536:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db616 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165548:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:0.0:1787602539.165551:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602539.165556:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db616 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165563:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db616 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165578:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09db61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165584:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09db61d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165589:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09db61d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165593:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602539.165597:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09db61d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165613:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09db61d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165622:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d350b502e00) 00010000:00010000:0.0:1787602539.165624:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602539.165627:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09db61d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165633:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09db61d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165669:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09db60f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2412 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165684:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3600/0x3640686da09db624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2412 expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.165690:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:0.0:1787602539.165691:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787602539.165693:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e3600, rc 0) 00000100:00100000:0.0:1787602539.165818:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+35:10385:x1874436833707520:12345-192.168.201.26@tcp:101:stat.0 Request processed in 1125us (1353us total) trans 0 rc 0/0 00000100:00080000:2.0:1787602539.165842:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602539.166304:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 55 00010000:00010000:0.0:1787602539.181006:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602539.286054:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602539.286134:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833707776 00000100:00100000:0.0:1787602539.286144:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833707776 00000100:00100000:0.0:1787602539.286222:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 56 00000100:00100000:0.0:1787602539.286233:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+35:10396:x1874436833707776:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602539.286267:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602539.286289:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09db62b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2419 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602539.286944:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787602539.289282:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09db62b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2419 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.289305:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:0.0:1787602539.289308:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602539.289314:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09db62b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2419 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.289332:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2400, rc 0) 00000100:00100000:0.0:1787602539.289429:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+36:10396:x1874436833707776:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 3189us (3377us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1787602539.289439:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 56 00000100:00100000:1.0:1787602539.300086:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602539.300393:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833708032 00000100:00100000:2.0:1787602539.300405:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833708032 00000100:00100000:2.0:1787602539.300628:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:2.0:1787602539.300641:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+36:10396:x1874436833708032:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:2.0:1787602539.308274:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+37:10396:x1874436833708032:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 7624us (8187us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787602539.308290:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:3.0:1787602539.417602:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602539.417793:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833708288 00000100:00100000:2.0:1787602539.417806:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833708288 00000100:00100000:2.0:1787602539.417898:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:2.0:1787602539.417909:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+37:10402:x1874436833708288:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787602539.417938:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602539.417961:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db639 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2420 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.418074:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db640 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.418102:0:8208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3600/0x3640686da09db624 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2412 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.418112:0:8208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db640 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.418168:0:8208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3600/0x3640686da09db624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2412 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.418182:0:8208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3600/0x3640686da09db624 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2412 expref: 38 pid: 5836 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602539.418197:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853662336:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602539.418304:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3508732a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787602539.425969:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853662336:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602539.426007:0:8208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db640 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602539.428053:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602539.428790:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833708416 00000100:00100000:2.0:1787602539.428802:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833708416 00010000:00010000:2.0:1787602539.428921:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3600/0x3640686da09db624 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2412 expref: 39 pid: 5836 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602539.428971:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:2.0:1787602539.428982:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d265880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+39:2351:x1874436833708416:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602539.428998:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602539.429005:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3600/0x3640686da09db624 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2412 expref: 39 pid: 5836 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.429020:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3600/0x3640686da09db624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2412 expref: 39 pid: 5836 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.429063:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3600/0x3640686da09db624 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2412 expref: 39 pid: 5836 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.429151:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:2.0:1787602539.429157:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db640 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.429167:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db640 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.429175:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db640 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.429333:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602539.429408:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d265880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+38:2351:x1874436833708416:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 426us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602539.429416:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 40 00010000:00010000:3.0:1787602539.431066:0:8208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db640 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602539.431156:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db640 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602539.431185:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787602539.432154:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db639 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2420 expref: 39 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.432182:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db640 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2420 expref: 38 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.432192:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:2.0:1787602539.432195:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787602539.432199:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5a00, rc 0) 00000100:00100000:2.0:1787602539.432719:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+38:10402:x1874436833708288:12345-192.168.201.26@tcp:101:bash.0 Request processed in 14808us (15126us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787602539.432780:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:1.0:1787602539.437308:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602539.437723:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833708672 00000100:00100000:2.0:1787602539.437736:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833708672 00000100:00100000:2.0:1787602539.437999:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 58 00000100:00100000:2.0:1787602539.438010:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d01b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+38:10402:x1874436833708672:12345-192.168.201.26@tcp:36:bash.0 00010000:00010000:2.0:1787602539.438309:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db64e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.438327:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db64e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.438338:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db64e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602539.438393:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787602539.438419:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aaa37e72 reply state 000000005f34cc08 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db64e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602539.438428:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787602539.438553:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d01b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+41:10402:x1874436833708672:12345-192.168.201.26@tcp:36:bash.0 Request processed in 544us (1256us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787602539.440696:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 58 00000020:00080000:2.0:1787602539.440708:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787602539.441285:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db64e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602539.441296:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db64e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602539.441304:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db64e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602539.441310:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602539.441315:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db64e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602539.441322:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db64e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602539.441359:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:3.0:1787602539.441362:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602539.441367:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db64e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602539.441374:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db64e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602539.443162:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602539.445959:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833708800 00000100:00100000:0.0:1787602539.445977:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833708800 00000100:00100000:0.0:1787602539.446063:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:0.0:1787602539.446085:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+40:10402:x1874436833708800:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:0.0:1787602539.446113:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602539.446140:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09db655 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2427 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.446234:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db65c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.446269:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db640 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2420 expref: 41 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.446278:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db65c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.446315:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db640 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2420 expref: 41 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.446330:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db640 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2420 expref: 41 pid: 8208 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602539.446345:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874436853662464:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787602539.446436:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35351f1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602539.453854:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602539.454706:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833708928 00000100:00100000:1.0:1787602539.454721:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833708928 00010000:00010000:1.0:1787602539.454884:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db640 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2420 expref: 42 pid: 8208 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602539.454936:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 41 00000100:00100000:1.0:1787602539.454946:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+42:2352:x1874436833708928:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602539.454965:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602539.454973:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db640 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2420 expref: 42 pid: 8208 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.455011:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db640 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2420 expref: 42 pid: 8208 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.455034:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:1.0:1787602539.455039:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db65c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.455049:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db65c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.455056:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db65c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.455201:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602539.455864:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+42:2352:x1874436833708928:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 914us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602539.455875:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 41 00010000:00010000:3.0:1787602539.456179:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db640 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2420 expref: 41 pid: 8208 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602539.456198:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874436853662464:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602539.456236:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db65c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.458544:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db65c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.458723:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db65c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602539.458985:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787602539.458991:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602539.459016:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db65c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.459065:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09db655 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2427 expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.459247:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db65c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2427 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.459256:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:1.0:1787602539.459259:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602539.459263:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2000, rc 0) 00000100:00100000:1.0:1787602539.459329:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+40:10402:x1874436833708800:12345-192.168.201.26@tcp:101:bash.0 Request processed in 13255us (16175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602539.459338:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:0.0:1787602539.465179:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602539.465274:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833709184 00000100:00100000:1.0:1787602539.465285:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833709184 00000100:00100000:1.0:1787602539.465405:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:1.0:1787602539.465419:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35079d1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+40:10402:x1874436833709184:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:1.0:1787602539.466072:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35079d1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+41:10402:x1874436833709184:12345-192.168.201.26@tcp:35:bash.0 Request processed in 654us (904us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787602539.469207:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:0.0:1787602539.609856:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602539.610020:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833709440 00000100:00100000:1.0:1787602539.610028:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833709440 00000100:00100000:1.0:1787602539.610093:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:1.0:1787602539.610102:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+41:10412:x1874436833709440:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787602539.610127:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602539.610147:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db663 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c242e expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602539.610634:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787602539.611681:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db663 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c242e expref: 43 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.611700:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:0.0:1787602539.611703:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602539.611708:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db663 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c242e expref: 43 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.611720:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354ea600, rc 0) 00000100:00100000:0.0:1787602539.615428:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+42:10412:x1874436833709440:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 5313us (5576us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1787602539.615453:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:0.0:1787602539.617810:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602539.617979:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833709568 00000100:00100000:1.0:1787602539.617990:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833709568 00000100:00100000:1.0:1787602539.618050:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:1.0:1787602539.618061:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+42:10412:x1874436833709568:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:1.0:1787602539.618463:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db671 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.618481:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db671 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.618492:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db671 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.618801:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09db678 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.618809:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09db678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.618890:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09db678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.619442:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db67f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.619454:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db67f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.619462:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db67f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602539.619695:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db67f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.619720:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db671 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.619728:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db671 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.619735:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db671 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.619943:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eb400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602539.619949:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db671 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.619958:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db671 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.619971:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:1.0:1787602539.619974:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602539.619979:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db671 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.619985:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db671 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.619998:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09db678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.620003:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09db678 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.620008:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09db678 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.620020:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eb200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602539.620023:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09db678 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.620028:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09db678 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.620036:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d350cd81f00) 00010000:00010000:1.0:1787602539.620038:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602539.620040:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09db678 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.620045:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09db678 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.620061:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db67f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.620066:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db67f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.620996:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db67f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.621010:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602539.621015:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db67f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.621021:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db67f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.621049:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:1.0:1787602539.621052:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602539.621056:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db67f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.621062:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db67f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602539.621179:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+42:10412:x1874436833709568:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 3114us (3373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602539.621188:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:0.0:1787602539.625406:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602539.625580:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833709824 00000100:00100000:2.0:1787602539.625592:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833709824 00000100:00100000:2.0:1787602539.625692:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:2.0:1787602539.625704:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+42:10412:x1874436833709824:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:2.0:1787602539.626372:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+43:10412:x1874436833709824:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 667us (975us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787602539.626388:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 16 00000004:00080000:1.0:1787602539.630279:0:8063:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 324576533143ns, next at 325576530641ns, rc = 0 00000100:00100000:1.0:1787602539.630307:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602539.630331:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853662592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602539.630412:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602539.630462:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853662592 00000100:00100000:1.0:1787602539.630470:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853662592 00000100:00100000:1.0:1787602539.630533:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787602539.630542:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874436853662592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602539.630584:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602539.630628:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874436853662592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602539.630635:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787602539.630708:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853662592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602539.685478:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602539.685692:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833710080 00000100:00100000:2.0:1787602539.685704:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833710080 00000100:00100000:2.0:1787602539.685833:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 62 00000100:00100000:2.0:1787602539.685845:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+43:10415:x1874436833710080:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787602539.685877:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602539.685905:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db686 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2435 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.685990:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db68d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686006:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db68d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686017:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db68d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686031:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686038:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686044:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686514:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db69b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686535:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db69b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686543:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db69b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602539.686554:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787602539.686670:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db68d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686678:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db68d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686684:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db68d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686690:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602539.686695:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db68d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686702:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db68d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686715:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:2.0:1787602539.686718:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602539.686723:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db68d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686729:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db68d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686793:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686807:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db694 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686813:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686818:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602539.686821:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686828:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db694 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686836:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3504d95d00) 00010000:00010000:2.0:1787602539.686839:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602539.686842:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db694 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686847:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db694 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686893:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db686 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2435 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686907:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db69b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2435 expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.686914:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:2.0:1787602539.686916:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602539.686926:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4200, rc 0) 00000100:00100000:2.0:1787602539.687001:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+45:10415:x1874436833710080:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1157us (1531us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787602539.687010:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 62 00000100:00100000:0.0:1787602539.692252:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602539.692299:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602539.692384:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833710208 00000100:00100000:1.0:1787602539.692394:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833710208 00000100:00100000:1.0:1787602539.692456:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 63 00000100:00100000:1.0:1787602539.692481:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+45:10415:x1874436833710208:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:1.0:1787602539.692550:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db6a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.692567:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.692579:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.692605:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.692612:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db6a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.692619:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.692625:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602539.692630:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.692638:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db6a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.692649:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:1.0:1787602539.692652:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602539.692657:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db6a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.692664:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db6a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602539.692780:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+45:10415:x1874436833710208:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 266us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602539.692789:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 63 00000100:00100000:3.0:1787602539.695629:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833710336 00000100:00100000:3.0:1787602539.695644:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833710336 00000100:00100000:3.0:1787602539.695716:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:3.0:1787602539.695727:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+45:2354:x1874436833710336:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602539.695770:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602539.695798:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db69b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2435 expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602539.695959:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:3.0:1787602539.695965:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602539.696089:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+44:2354:x1874436833710336:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 363us (3789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602539.696114:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:0.0:1787602539.696340:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602539.697950:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833710592 00000100:00100000:2.0:1787602539.697965:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833710592 00000100:00100000:2.0:1787602539.698084:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:2.0:1787602539.698096:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+44:10415:x1874436833710592:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:2.0:1787602539.698399:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+45:10415:x1874436833710592:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 304us (2058us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787602539.698407:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:1.0:1787602539.741936:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602539.741983:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602539.742021:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602539.742207:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833710976 00000100:00100000:0.0:1787602539.742223:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833710976 00000100:00100000:0.0:1787602539.742303:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 138 00000100:00100000:0.0:1787602539.742314:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2354:x1874436833710976:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602539.742401:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2354:x1874436833710976:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 88us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602539.742408:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 138 00000100:00100000:2.0:1787602539.742783:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833710848 00000100:00100000:2.0:1787602539.742788:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833710848 00000100:00100000:2.0:1787602539.742845:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 77 00000100:00100000:2.0:1787602539.742854:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d21b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833710848:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602539.742892:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d21b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833710848:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 41us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602539.742900:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 77 00000100:00100000:3.0:1787602539.743134:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833710720 00000100:00100000:3.0:1787602539.743139:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833710720 00000100:00100000:3.0:1787602539.743177:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 288 00000100:00100000:3.0:1787602539.743185:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833710720:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602539.743215:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833710720:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 32us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602539.743222:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 288 00000100:00080000:1.0:1787602539.743377:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602539.743383:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602539.896025:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602539.896184:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833711232 00000100:00100000:2.0:1787602539.896194:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833711232 00000100:00100000:2.0:1787602539.896266:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00100000:2.0:1787602539.896278:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+45:10433:x1874436833711232:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:2.0:1787602539.896305:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602539.896326:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db6b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c243c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.896445:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db6b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.896458:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db6b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.896467:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db6b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602539.896477:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787602539.896737:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db6b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c243c expref: 48 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.896813:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db6b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c243c expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.896822:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:2.0:1787602539.896825:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787602539.896828:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5400, rc 0) 00000100:00100000:2.0:1787602539.896945:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+47:10433:x1874436833711232:12345-192.168.201.26@tcp:101:cat.0 Request processed in 668us (929us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787602539.896953:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00100000:1.0:1787602539.959970:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602539.962477:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833711360 00000100:00100000:0.0:1787602539.962493:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833711360 00000100:00100000:0.0:1787602539.962646:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00100000:0.0:1787602539.962659:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+47:10434:x1874436833711360:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602539.962688:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602539.962712:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2200/0x3640686da09db6c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2443 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.962831:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09db6cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.962848:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09db6cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.962892:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09db6cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602539.963100:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787602539.963104:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602539.963196:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09db6cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.963240:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2200/0x3640686da09db6c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2443 expref: 49 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.963258:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09db6cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2443 expref: 48 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602539.963267:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:0.0:1787602539.963270:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787602539.963274:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2600, rc 0) 00000100:00100000:0.0:1787602539.963354:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+48:10434:x1874436833711360:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 698us (3394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602539.963361:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00100000:2.0:1787602539.971593:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602539.971668:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833711744 00000100:00100000:1.0:1787602539.971678:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833711744 00000100:00100000:1.0:1787602539.971727:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:1.0:1787602539.971736:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+48:10434:x1874436833711744:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787602539.972307:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+49:10434:x1874436833711744:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 570us (723us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787602539.972315:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:3.0:1787602539.979401:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602539.980265:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833711872 00000100:00100000:2.0:1787602539.980277:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833711872 00000100:00100000:2.0:1787602539.980384:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:2.0:1787602539.980395:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d266300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+49:10434:x1874436833711872:12345-192.168.201.26@tcp:103:lfs.0 00010000:00010000:2.0:1787602539.980428:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787602539.980459:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db65c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2427 expref: 49 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.980485:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db6b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c243c expref: 48 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.980500:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09db567 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23e8 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602539.980513:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502100) 00010000:00010000:2.0:1787602539.980523:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602539.980590:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d266300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+46:10434:x1874436833711872:12345-192.168.201.26@tcp:103:lfs.0 Request processed in 196us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602539.980598:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:3.0:1787602539.983652:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602539.985311:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833712000 00000100:00100000:1.0:1787602539.985901:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833712000 00000100:00100000:1.0:1787602539.986099:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 66 00000100:00100000:1.0:1787602539.986112:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+46:10434:x1874436833712000:12345-192.168.201.26@tcp:58:lfs.0 00010000:00010000:1.0:1787602539.986257:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db6d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.986276:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db6d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602539.986307:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db6d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787602539.986630:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787602539.986896:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787602539.986971:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787602539.987096:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+46:10434:x1874436833712000:12345-192.168.201.26@tcp:58:lfs.0 Request processed in 984us (3451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602539.987104:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 66 00000100:00100000:0.0:1787602540.018128:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602540.018234:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833712128 00000100:00100000:2.0:1787602540.018245:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833712128 00000100:00100000:2.0:1787602540.018308:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 67 00000100:00100000:2.0:1787602540.018319:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+46:10436:x1874436833712128:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787602540.018338:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602540.018359:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db6da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c244a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.018449:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db6e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.018464:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db6e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.018483:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db6e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.018501:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db6e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.018509:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db6e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.018516:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db6e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.018873:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db6ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.018883:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db6ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.018891:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db6ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602540.018930:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787602540.018934:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602540.018952:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db6ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.018963:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db6ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.018971:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db6e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.018989:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db6e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.018995:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db6e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.019001:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602540.019006:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db6e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.019014:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db6e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.019027:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:2.0:1787602540.019030:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602540.019035:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db6e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.019041:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db6e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.019054:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db6e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.019059:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db6e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.019064:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db6e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.019069:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602540.019079:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db6e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.019086:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db6e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.019093:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3504d95d00) 00010000:00010000:2.0:1787602540.019096:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602540.019099:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db6e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.019104:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db6e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.019139:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db6da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c244a expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.019151:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db6ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c244a expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.019158:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81f00) 00010000:00010000:2.0:1787602540.019160:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787602540.019162:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4600, rc 0) 00000100:00100000:2.0:1787602540.019236:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+47:10436:x1874436833712128:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 918us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602540.019244:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 67 00010000:00010000:3.0:1787602540.206129:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787602540.796365:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787602540.796376:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787602540.796430:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787602540.796438:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787602540.797692:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d646300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874436853662720:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787602540.798196:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3508732a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787602540.812501:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d646300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874436853662720:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787602540.829545:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602540.829628:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833712256 00000100:00100000:2.0:1787602540.829639:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833712256 00000100:00100000:2.0:1787602540.829700:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:2.0:1787602540.829711:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e3aefeab-67b4-4a0a-9090-6916c4553638+47:10447:x1874436833712256:12345-192.168.201.26@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787602540.830005:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e3aefeab-67b4-4a0a-9090-6916c4553638+47:10447:x1874436833712256:12345-192.168.201.26@tcp:900:lhsmtool_posix.0 Request processed in 294us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602540.830014:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:0.0:1787602540.832864:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602540.833095:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833712384 00000100:00100000:2.0:1787602540.833106:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833712384 00000100:00100000:2.0:1787602540.833177:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00100000:2.0:1787602540.833189:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+47:10447:x1874436833712384:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787602540.833346:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787602540.833466:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+47:10447:x1874436833712384:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 279us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602540.833474:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00100000:3.0:1787602540.839569:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602540.840115:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833712512 00000100:00100000:2.0:1787602540.840128:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833712512 00000100:00100000:2.0:1787602540.840859:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 69 00000100:00100000:2.0:1787602540.840872:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+47:10447:x1874436833712512:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787602540.840957:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09db6f6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.840975:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09db6f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841008:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09db6f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841027:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09db6fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841035:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09db6fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841041:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09db6fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841068:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db704 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841077:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841083:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602540.841122:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787602540.841126:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602540.841150:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841162:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09db6f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841168:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09db6f6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841184:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09db6f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841190:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602540.841194:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09db6f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841201:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09db6f6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841213:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d350b502400) 00010000:00010000:2.0:1787602540.841228:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602540.841233:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09db6f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841238:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09db6f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841251:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09db6fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841257:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09db6fd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841262:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09db6fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841267:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602540.841269:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09db6fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841283:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09db6fd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841291:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8d3504d95d00) 00010000:00010000:2.0:1787602540.841293:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602540.841295:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09db6fd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841301:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09db6fd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841314:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841320:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db704 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841326:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841330:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602540.841333:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841338:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db704 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841345:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81f00) 00010000:00010000:2.0:1787602540.841347:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602540.841350:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db704 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602540.841364:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db704 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602540.841457:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+47:10447:x1874436833712512:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 Request processed in 588us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602540.841465:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 69 00000100:00100000:0.0:1787602540.853232:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602540.853463:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833712768 00000100:00100000:3.0:1787602540.853473:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833712768 00000100:00100000:3.0:1787602540.853533:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 70 00000100:00100000:3.0:1787602540.853545:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+47:10447:x1874436833712768:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602540.853568:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602540.853592:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db70b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2451 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.853706:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db712 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.853721:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.853768:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602540.853794:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787602540.853898:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db712 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.853907:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db712 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.853913:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.853931:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602540.853935:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db712 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.853941:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db712 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.853951:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81f00) 00010000:00010000:3.0:1787602540.853953:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602540.853956:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db712 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.853960:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db712 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.854003:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db70b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2451 expref: 49 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.854011:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d350b502400) 00010000:00010000:3.0:1787602540.854012:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787602540.854019:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db70b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2451 expref: 49 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.854026:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433a00, rc 0) 00000100:00100000:3.0:1787602540.854090:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+48:10447:x1874436833712768:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 547us (875us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1787602540.854098:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 70 00000100:00100000:1.0:1787602540.861214:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602540.862026:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833712896 00000100:00100000:2.0:1787602540.862038:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833712896 00000100:00100000:2.0:1787602540.862111:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 71 00000100:00100000:2.0:1787602540.862123:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+48:10447:x1874436833712896:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787602540.862174:0:8208:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787602540.862298:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+48:10447:x1874436833712896:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 177us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602540.862305:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 71 00000100:00100000:1.0:1787602540.871382:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602540.872354:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833713152 00000100:00100000:3.0:1787602540.872367:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833713152 00000100:00100000:3.0:1787602540.872436:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 72 00000100:00100000:3.0:1787602540.872449:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+48:10447:x1874436833713152:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602540.872476:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602540.872479:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787602540.872511:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09db6cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2443 expref: 48 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.872534:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:3.0:1787602540.872539:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602540.872554:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db720 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2458 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787602540.874000:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787602540.874241:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db727 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.874257:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.874268:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.874349:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db720 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2458 expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.874367:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2458 expref: 49 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.874375:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3529dc7200) 00010000:00010000:3.0:1787602540.874378:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602540.874381:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433e00, rc 0) 00000100:00100000:3.0:1787602540.874467:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+49:10447:x1874436833713152:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 2019us (3094us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787602540.874476:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 72 00000100:00100000:2.0:1787602540.888199:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602540.888452:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833713408 00000100:00100000:0.0:1787602540.888463:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833713408 00000100:00100000:0.0:1787602540.888525:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 73 00000100:00100000:0.0:1787602540.888537:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+49:10447:x1874436833713408:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787602540.888603:0:8208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602540.888631:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db727 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2458 expref: 49 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.888650:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3529dc7200) 00010000:00010000:0.0:1787602540.888660:0:8208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602540.888686:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09db735 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.888699:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09db735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.888708:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09db735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.888794:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db73c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x37ddf699 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.888803:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db73c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37ddf699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.888810:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db73c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37ddf699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.889301:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09db735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.889311:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09db735 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.889318:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09db735 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.889331:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e2a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602540.889335:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09db735 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.889342:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09db735 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.889352:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:0.0:1787602540.889355:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602540.889359:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09db735 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.889366:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09db735 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.889378:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db73c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37ddf699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.889384:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db73c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37ddf699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.889389:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db73c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37ddf699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.889395:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e2e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602540.889397:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db73c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37ddf699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.889403:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db73c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37ddf699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.889422:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x37ddf699 (ffff8d350b502e00) 00010000:00010000:0.0:1787602540.889424:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602540.889428:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db73c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x37ddf699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.889434:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db73c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x37ddf699 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602540.889538:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+48:10447:x1874436833713408:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 1003us (1347us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787602540.889546:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 73 00000100:00100000:1.0:1787602540.901449:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602540.903316:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833713536 00000100:00100000:3.0:1787602540.903330:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833713536 00000100:00100000:3.0:1787602540.903430:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 74 00000100:00100000:3.0:1787602540.903443:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+48:10447:x1874436833713536:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602540.903464:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602540.903489:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db743 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c245f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.903527:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db74a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.903542:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db74a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.903555:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db74a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.903661:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db743 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c245f expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.903679:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db74a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c245f expref: 49 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602540.903689:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3529dc7900) 00010000:00010000:3.0:1787602540.903693:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787602540.903696:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432200, rc 0) 00000100:00100000:3.0:1787602540.903812:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+49:10447:x1874436833713536:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 371us (2380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602540.903819:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 74 00000100:00100000:3.0:1787602540.913506:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602540.915405:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833713792 00000100:00100000:0.0:1787602540.915422:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833713792 00000100:00100000:0.0:1787602540.915489:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 75 00000100:00100000:0.0:1787602540.915501:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+49:10447:x1874436833713792:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787602540.915592:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db751 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.915613:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602540.915626:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787602540.915985:0:8208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1787602540.916344:0:8208:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325862600213ns, next at 326862595799ns, rc = 0 00000004:00010000:0.0:1787602540.916478:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d45172e4 reply state 000000002dec890a transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602540.916508:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602540.916644:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+51:10447:x1874436833713792:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 1143us (3146us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787602540.916652:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 75 00010000:00010000:1.0:1787602540.923457:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602540.923474:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db751 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602540.923482:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db751 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602540.923488:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e2e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602540.923493:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db751 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602540.923500:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db751 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602540.923532:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3529dc7900) 00010000:00010000:1.0:1787602540.923535:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787602540.923540:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db751 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602540.923546:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09db751 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602540.923854:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602540.924115:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833713920 00000100:00100000:1.0:1787602540.924128:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833713920 00000100:00100000:1.0:1787602540.924188:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 76 00000100:00100000:1.0:1787602540.924199:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+50:10447:x1874436833713920:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602540.924237:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602540.924258:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db758 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2466 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602540.924328:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db758 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2466 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602540.924344:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db758 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2466 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602540.924368:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3529dc7900) 00010000:00010000:1.0:1787602540.924371:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787602540.924374:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eac00, rc 0) 00000100:00100000:1.0:1787602540.924465:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+51:10447:x1874436833713920:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 267us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602540.924486:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 76 00000100:00100000:3.0:1787602540.928088:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602540.928178:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833714048 00000100:00100000:2.0:1787602540.928190:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833714048 00000100:00100000:2.0:1787602540.928253:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:2.0:1787602540.928261:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d101f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1874436833714048:12345-192.168.201.26@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787602540.928302:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp t0 exp 0000000000000000 cur 325 last 0 00000020:00000080:2.0:1787602540.928337:0:6691:0:(genops.c:1385:class_connect()) connect: client e3aefeab-67b4-4a0a-9090-6916c4553638, cookie 0x3640686da09db75f 00002000:00100000:2.0:1787602540.928349:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e3aefeab-67b4-4a0a-9090-6916c4553638/ffff8d35050fd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787602540.928377:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787602540.928640:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787602540.928683:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8d35050f9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787602540.928793:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d101f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2350:x1874436833714048:12345-192.168.201.26@tcp:8:lhsmtool_posix.0 Request processed in 531us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602540.928801:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:1.0:1787602540.947479:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602540.947580:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833714176 00000100:00100000:2.0:1787602540.947591:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833714176 00000100:00100000:2.0:1787602540.947665:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:2.0:1787602540.947676:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:0:x1874436833714176:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787602540.951053:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787602540.966639:0:11996:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787602540.966648:0:11996:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787602540.966691:0:11996:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787602540.966697:0:11996:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787602541.025406:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:0:x1874436833714176:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 77531us (77736us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787602541.025421:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 25 00000001:00080000:3.0:1787602541.025461:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:3.0:1787602541.025471:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e3aefeab-67b4-4a0a-9090-6916c4553638 00000100:00100000:1.0:1787602541.049937:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602541.052865:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833714432 00000100:00100000:0.0:1787602541.052882:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833714432 00000100:00100000:0.0:1787602541.052965:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:0.0:1787602541.052981:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+51:10447:x1874436833714432:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787602541.053237:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+52:10447:x1874436833714432:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 261us (3311us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787602541.053245:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00080000:0.0:1787602541.054176:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602541.065651:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602541.066386:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833714688 00000100:00100000:3.0:1787602541.066397:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833714688 00000100:00100000:3.0:1787602541.066466:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 77 00000100:00100000:3.0:1787602541.066478:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+52:10447:x1874436833714688:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787602541.066595:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+52:10447:x1874436833714688:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 118us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602541.066617:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 77 00000100:00100000:0.0:1787602541.072504:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602541.072576:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833714816 00000100:00100000:3.0:1787602541.072586:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833714816 00000100:00100000:3.0:1787602541.072642:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 78 00000100:00100000:3.0:1787602541.072653:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+52:10447:x1874436833714816:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602541.072672:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602541.072693:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db766 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c246d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.072794:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db76d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.072808:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db76d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.072820:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db76d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602541.072856:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602541.072875:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db76d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.072902:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db766 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c246d expref: 54 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.072919:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db76d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c246d expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.072928:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3529dc7900) 00010000:00010000:3.0:1787602541.072942:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787602541.072946:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433000, rc 0) 00000100:00100000:3.0:1787602541.073019:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+53:10447:x1874436833714816:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 368us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602541.073026:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 78 00000100:00100000:3.0:1787602541.076206:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602541.078092:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833714944 00000100:00100000:2.0:1787602541.078109:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833714944 00000100:00100000:2.0:1787602541.078174:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00100000:2.0:1787602541.078186:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d102300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2351:x1874436833714944:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602541.078205:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602541.078230:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09db774 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2474 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787602541.078258:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8ca66d, blocks: 0x1 00010000:00010000:2.0:1787602541.078281:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=326s v=(0 0) 00010000:00010000:2.0:1787602541.078287:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602541.078297:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09db774 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2474 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.078316:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09db774 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2474 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.078340:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5600, rc 0) 00000100:00100000:2.0:1787602541.078409:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d102300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2351:x1874436833714944:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 225us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602541.078417:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00100000:1.0:1787602541.082134:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602541.082209:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833715200 00000100:00100000:3.0:1787602541.082345:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833715200 00000100:00100000:3.0:1787602541.082443:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 79 00000100:00100000:3.0:1787602541.082454:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+53:10447:x1874436833715200:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787602541.082574:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+53:10447:x1874436833715200:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 122us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602541.082582:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 79 00000100:00100000:0.0:1787602541.093095:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602541.093183:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833715328 00000100:00100000:1.0:1787602541.093194:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833715328 00000100:00100000:1.0:1787602541.093263:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 27 00000100:00100000:1.0:1787602541.093275:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:10447:x1874436833715328:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602541.093291:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602541.093311:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0032d5a/0x3640686da09db77b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c247b expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.093342:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09db774 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2474 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.093351:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602541.093356:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602541.093362:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0032d5a/0x3640686da09db77b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c247b expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.093397:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09db774 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2474 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.093411:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09db774 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2474 expref: 7 pid: 6691 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602541.093441:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35357dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1874436853662848:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602541.093534:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503365840 going to sleep for 11 seconds 00000100:00100000:2.0:1787602541.097287:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602541.097428:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35357dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1874436853662848:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787602541.097461:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0032d5a/0x3640686da09db77b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c247b expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602541.097481:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354ea000, rc 0) 00000100:00100000:0.0:1787602541.097545:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+7:10447:x1874436833715328:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 4271us (4459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602541.097554:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 27 00000100:00100000:3.0:1787602541.097626:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833715456 00000100:00100000:3.0:1787602541.097633:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833715456 00010000:00010000:3.0:1787602541.097666:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09db774 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2474 expref: 7 pid: 6691 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602541.097701:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 42 00000100:00100000:3.0:1787602541.097711:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3509d57c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2352:x1874436833715456:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602541.097733:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602541.097777:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09db774 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2474 expref: 7 pid: 6691 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.097790:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09db774 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2474 expref: 7 pid: 6691 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.097829:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09db774 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2474 expref: 7 pid: 6691 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.097843:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602541.097848:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602541.097855:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0032d5a/0x3640686da09db77b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c247b expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.097864:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0032d5a/0x3640686da09db77b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c247b expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.097911:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a0032d5a/0x3640686da09db77b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c247b expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602541.097926:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d4b7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1874436853662976:192.168.201.26@tcp:105: 00000100:00100000:3.0:1787602541.097976:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af52900 going to sleep for 11 seconds 00000100:00100000:3.0:1787602541.102223:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d4b7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1874436853662976:192.168.201.26@tcp:105: 00010000:00010000:3.0:1787602541.102252:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602541.102346:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3509d57c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833715456:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 4634us (5065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602541.102357:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 42 00000100:00100000:1.0:1787602541.106205:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602541.106400:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833715584 00000100:00100000:3.0:1787602541.106412:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833715584 00002000:00100000:3.0:1787602541.106463:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d35357ded80 x1874436833715584/t0(0) o4->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:377/0 lens 504/0 e 0 to 0 dl 1787602552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787602541.106482:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d35357ded80 with x1874436833715584 ext(0->8) 00002000:00010000:3.0:1787602541.106487:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d35357ded80 00000100:00100000:3.0:1787602541.106525:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:3.0:1787602541.106535:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833715584:12345-192.168.201.26@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787602541.107280:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2352:x1874436833715584:12345-192.168.201.26@tcp:4:lhsmtool_posix.0 Request processed in 744us (1082us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787602541.107290:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00002000:00100000:3.0:1787602541.107299:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d35357ded80 x1874436833715584/t4294967302(0) o4->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:377/0 lens 504/448 e 0 to 0 dl 1787602552 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787602541.107308:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d35357ded80 with x1874436833715584 ext(0->8) 00002000:00010000:3.0:1787602541.107313:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d35357ded80 00000100:00100000:1.0:1787602541.119680:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602541.119783:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833715712 00000100:00100000:3.0:1787602541.119803:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833715712 00000100:00100000:3.0:1787602541.119861:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 80 00000100:00100000:3.0:1787602541.119871:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+53:10447:x1874436833715712:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1787602541.231204:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787602541.236337:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1787602541.236358:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:2.0:1787602541.236392:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:2.0:1787602541.236428:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787602541.236438:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d353ca93480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787602541.236442:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d353d65a600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d353ca93cc0 00000020:00080000:2.0:1787602541.236446:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d353d65af00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d3528fcc000 00000020:00080000:2.0:1787602541.236675:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787602541.237006:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787602541.237029:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853663104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787602541.237104:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602541.237170:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602541.237177:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853663232:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787602541.237264:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602541.237305:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853663104 00000100:00100000:2.0:1787602541.237312:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853663104 00000100:00100000:2.0:1787602541.237368:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853663232 00000100:00100000:2.0:1787602541.237371:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853663232 00000100:00100000:2.0:1787602541.237394:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787602541.237403:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853663104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787602541.237561:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787602541.237565:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787602542 00002000:00010000:2.0:1787602541.237567:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787602541.237569:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787602541 -> 1787602542 00002000:00010000:2.0:1787602541.237571:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787602541.237614:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1874436853663104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 211us (509us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787602541.237622:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787602541.237638:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787602541.237644:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1874436853663232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787602541.237657:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787602541.237685:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8ca66a, atime: 0x6a8ca66a, ctime: 0x6a8ca66a, blocks: 0xb 00010000:00010000:2.0:1787602541.237693:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dafcbc90/0x3640686da09db782 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.238083:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:2.0:1787602541.238089:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602541.238095:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dafcbc90/0x3640686da09db782 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.238112:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dafcbc90/0x3640686da09db782 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.238121:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dafcbc90/0x3640686da09db782 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.238141:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dafcbc90/0x3640686da09db782 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.238157:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787602541.238459:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602541.238467:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dafcbc90/0x3640686da09db782 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.238476:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5200 already unused, calling callback (ffffffffc1656230) 00010000:00010000:3.0:1787602541.238480:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dafcbc90/0x3640686da09db782 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.238500:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dafcbc90/0x3640686da09db782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.238518:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dafcbc90/0x3640686da09db782 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.238525:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dafcbc90/0x3640686da09db782 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.238546:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602541.238548:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602541.238549:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787602541.238846:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787602541.238851:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787602541.238972:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+13:10447:x1874436833715712:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 Request processed in 119098us (119301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602541.238981:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 80 00000004:00080000:3.0:1787602541.242146:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d353d646300/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787602541.242162:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853663104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787602541.243563:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1874436853663232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5913us (6293us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787602541.243575:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787602541.252969:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000004:00080000:3.0:1787602541.253236:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d353d489180/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787602541.253249:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853663232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787602541.253463:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833715840 00000100:00100000:0.0:1787602541.253473:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833715840 00000100:00100000:0.0:1787602541.253528:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 30 00000100:00100000:0.0:1787602541.253539:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2351:x1874436833715840:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787602541.306350:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2351:x1874436833715840:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 Request processed in 52800us (53376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602541.306364:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 30 00000001:00080000:3.0:1787602541.306442:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1787602541.306455:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1787602541.310103:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602541.310296:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833716096 00000100:00100000:1.0:1787602541.310316:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833716096 00000100:00100000:1.0:1787602541.310376:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 81 00000100:00100000:1.0:1787602541.310387:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+13:10447:x1874436833716096:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787602541.310440:0:8208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602541.310468:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db76d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c246d expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.310487:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3529dc7900) 00010000:00010000:1.0:1787602541.310493:0:8208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602541.310526:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09db789 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.310540:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09db789 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.310550:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09db789 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787602541.310919:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f92849bf reply state 000000001ea66dbf transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09db789 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602541.310931:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602541.311230:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+14:10447:x1874436833716096:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 843us (1136us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787602541.311240:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 81 00010000:00010000:3.0:1787602541.313228:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09db789 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.313267:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09db789 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.313275:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09db789 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.313281:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eaa00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602541.313287:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09db789 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.313295:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09db789 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.313311:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3529dc7900) 00010000:00010000:3.0:1787602541.313314:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602541.313319:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09db789 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.313324:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09db789 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602541.314107:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602541.314230:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833716224 00000100:00100000:3.0:1787602541.314241:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833716224 00000100:00100000:3.0:1787602541.314308:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00100000:3.0:1787602541.314318:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2354:x1874436833716224:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787602541.314569:0:8625:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787602541.314574:0:8625:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787602542 -> 1787602540 00002000:00010000:3.0:1787602541.314576:0:8625:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787602538 00002000:00010000:3.0:1787602541.314579:0:8625:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787602542 -> 1787602540 00002000:00010000:3.0:1787602541.314591:0:8625:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787602541.314656:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2354:x1874436833716224:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 338us (552us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787602541.314664:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00100000:2.0:1787602541.316908:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602541.316996:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833716480 00000100:00100000:1.0:1787602541.317006:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833716480 00000100:00100000:1.0:1787602541.317061:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 82 00000100:00100000:1.0:1787602541.317071:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d48ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+13:10447:x1874436833716480:12345-192.168.201.26@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787602541.317156:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db790 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.317172:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db74a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c245f expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.317181:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db790 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.317215:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db74a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c245f expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.317228:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db74a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c245f expref: 13 pid: 5836 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602541.317242:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35357ddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853663360:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602541.317338:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503365b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602541.319679:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35357ddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853663360:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602541.319727:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db790 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602541.320417:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602541.320483:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833716608 00000100:00100000:3.0:1787602541.320491:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833716608 00010000:00010000:3.0:1787602541.320529:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db74a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c245f expref: 14 pid: 5836 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602541.320568:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:3.0:1787602541.320578:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d48a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+14:2351:x1874436833716608:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602541.320591:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602541.320598:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db74a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c245f expref: 14 pid: 5836 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.320610:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db74a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c245f expref: 14 pid: 5836 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.320632:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db74a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c245f expref: 14 pid: 5836 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.320648:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3529dc7900) 00010000:00010000:3.0:1787602541.320654:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db790 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.320663:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.320687:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db790 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.320727:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602541.320928:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d48a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+13:2351:x1874436833716608:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 350us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602541.320933:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 43 00010000:00010000:1.0:1787602541.321200:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.321210:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.321242:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.321260:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db790 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.321267:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db790 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.321274:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ebc00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602541.321278:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db790 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.321285:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db790 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.321295:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3529dc7900) 00010000:00010000:1.0:1787602541.321298:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787602541.321313:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db790 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.321320:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db790 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602541.321376:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d48ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+12:10447:x1874436833716480:12345-192.168.201.26@tcp:55:lhsmtool_posix.0 Request processed in 4306us (4475us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787602541.321385:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 82 00000100:00100000:2.0:1787602541.324207:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602541.324316:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833716736 00000100:00100000:3.0:1787602541.324324:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833716736 00000100:00100000:3.0:1787602541.324425:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00100000:3.0:1787602541.324435:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cb3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2352:x1874436833716736:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787602541.324480:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c535301a/0x3640686da09db797 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.324503:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0032d5a/0x3640686da09db77b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c247b expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.324512:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602541.324516:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787602541.324521:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c535301a/0x3640686da09db797 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.324558:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0032d5a/0x3640686da09db77b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c247b expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.324572:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0032d5a/0x3640686da09db77b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c247b expref: 7 pid: 6690 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602541.324602:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d4b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1874436853663488:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787602541.324693:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af52840 going to sleep for 11 seconds 00000100:00100000:1.0:1787602541.327076:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d4b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1874436853663488:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602541.327106:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c535301a/0x3640686da09db797 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602541.329632:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602541.329703:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833716864 00000100:00100000:0.0:1787602541.329714:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833716864 00010000:00010000:0.0:1787602541.330054:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0032d5a/0x3640686da09db77b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c247b expref: 8 pid: 6690 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602541.330139:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:0.0:1787602541.330151:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d489f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2351:x1874436833716864:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602541.330168:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602541.330195:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0032d5a/0x3640686da09db77b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c247b expref: 8 pid: 6690 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602541.330238:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0032d5a/0x3640686da09db77b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c247b expref: 8 pid: 6690 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602541.330270:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0032d5a/0x3640686da09db77b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c247b expref: 8 pid: 6690 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602541.330287:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602541.330291:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602541.330298:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c535301a/0x3640686da09db797 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602541.330307:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c535301a/0x3640686da09db797 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602541.330340:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602541.330384:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c535301a/0x3640686da09db797 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.330404:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c535301a/0x3640686da09db797 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602541.330410:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d489f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833716864:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 260us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602541.330425:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 44 00010000:00010000:1.0:1787602541.330441:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c535301a/0x3640686da09db797 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.330451:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c535301a/0x3640686da09db797 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.330460:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c535301a/0x3640686da09db797 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.330468:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433a00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602541.330474:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c535301a/0x3640686da09db797 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.330483:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c535301a/0x3640686da09db797 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.330497:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c535301a/0x3640686da09db797 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.330505:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c535301a/0x3640686da09db797 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602541.330596:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cb3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833716736:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 Request processed in 6161us (6396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602541.330604:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00100000:2.0:1787602541.338060:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602541.338127:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833717120 00000100:00100000:3.0:1787602541.338137:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833717120 00000100:00100000:3.0:1787602541.338243:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 83 00000100:00100000:3.0:1787602541.338263:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+12:10447:x1874436833717120:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787602541.338359:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db79e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.338377:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db79e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.338390:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db79e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.338612:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db7a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.338624:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db758 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2466 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.338632:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db7a5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.338666:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db758 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2466 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.338681:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db758 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2466 expref: 13 pid: 5837 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602541.338709:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d4b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874436853663616:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787602541.338845:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af526c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602541.343942:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d4b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874436853663616:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602541.343975:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db7a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602541.346511:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602541.346621:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833717248 00000100:00100000:3.0:1787602541.346630:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833717248 00010000:00010000:3.0:1787602541.346671:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db758 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2466 expref: 14 pid: 5837 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602541.346711:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:3.0:1787602541.346735:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d48aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+14:2351:x1874436833717248:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602541.346772:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602541.346780:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db758 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2466 expref: 14 pid: 5837 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.346800:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db758 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2466 expref: 14 pid: 5837 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.346831:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db758 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2466 expref: 14 pid: 5837 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.346847:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3529dc7900) 00010000:00010000:3.0:1787602541.346852:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db7a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.346877:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db7a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.346883:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db7a5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.346917:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602541.346982:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d48aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+13:2351:x1874436833717248:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 261us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602541.346990:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 45 00010000:00010000:2.0:1787602541.347058:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db7a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.347068:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db7a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602541.347258:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1787602541.347418:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787602541.347465:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1787602541.347564:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d489500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5838:1874436853663744:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787602541.347612:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602541.347659:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353d5946c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602541.349630:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853663744 00000100:00100000:0.0:1787602541.349643:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853663744 00000100:00100000:0.0:1787602541.349703:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787602541.349713:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d48b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1874436853663744:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787602541.349887:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d48b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1874436853663744:12345-0@lo:1000:mdt00_002.0 Request processed in 175us (2274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602541.349895:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787602541.349973:0:5838:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787602541.349979:0:5838:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d353d646300, transno 4294967303 00000100:00100000:2.0:1787602541.350017:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d489500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5838:1874436853663744:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787602541.350583:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787602541.350663:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d489500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5838:1874436853663872:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787602541.350714:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602541.351157:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353d594180 going to sleep for 11 seconds 00000100:00100000:1.0:1787602541.355535:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853663872 00000100:00100000:1.0:1787602541.355553:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853663872 00000100:00100000:1.0:1787602541.355620:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602541.355632:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d48b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1874436853663872:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787602541.356246:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d48b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5838:x1874436853663872:12345-0@lo:1000:mdt00_002.0 Request processed in 614us (5530us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787602541.356255:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787602541.357169:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d489500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5838:1874436853663872:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787602541.357218:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db7a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357228:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db7a5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357235:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db7a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357240:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602541.357244:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db7a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357251:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db7a5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357266:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d3529dc7900) 00010000:00010000:2.0:1787602541.357269:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602541.357275:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db7a5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357281:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db7a5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357564:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db6d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357586:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db6d3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357591:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db6d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357596:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eba00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602541.357599:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db6d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357604:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db6d3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357613:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81f00) 00010000:00010000:2.0:1787602541.357616:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602541.357618:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db6d3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357623:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db6d3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357646:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357661:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db6ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c244a expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357670:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7ac lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357706:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db6ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c244a expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.357737:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db6ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c244a expref: 16 pid: 5838 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602541.357774:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d488700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874436853664000:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602541.357881:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353d594180 going to sleep for 11 seconds 00000100:00100000:3.0:1787602541.364779:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602541.365389:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833717376 00000100:00100000:2.0:1787602541.365400:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833717376 00010000:00010000:2.0:1787602541.365447:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db6ef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c244a expref: 17 pid: 5838 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602541.365490:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:2.0:1787602541.365500:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+17:2352:x1874436833717376:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602541.365518:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602541.365525:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db6ef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c244a expref: 17 pid: 5838 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.365539:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db6ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c244a expref: 17 pid: 5838 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.365563:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81f00) 00010000:00010000:2.0:1787602541.365569:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.365579:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.365605:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7ac lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.365627:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602541.365684:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+17:2352:x1874436833717376:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 184us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602541.365691:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 46 00010000:00010000:1.0:1787602541.365930:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db6ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c244a expref: 16 pid: 5838 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602541.365949:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d488700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874436853664000:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602541.365970:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.365980:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.365986:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.365998:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.366006:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.366020:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.366026:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602541.366031:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.366039:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.366049:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81f00) 00010000:00010000:1.0:1787602541.366053:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602541.366057:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.366064:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.366074:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db79e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.366081:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db79e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.366086:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db79e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.366091:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602541.366094:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db79e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.366110:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db79e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.366119:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81f00) 00010000:00010000:1.0:1787602541.366122:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787602541.366124:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db79e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.366130:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db79e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602541.366355:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+15:10447:x1874436833717120:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 28094us (28302us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1787602541.366365:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 83 00000020:00080000:1.0:1787602541.366368:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787602541.366487:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787602541.366492:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787602541.366520:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787602541.366525:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787602541.373801:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602541.374598:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833717632 00000100:00100000:0.0:1787602541.374610:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833717632 00000100:00100000:0.0:1787602541.374686:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:0.0:1787602541.374698:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+15:10447:x1874436833717632:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787602541.378460:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787602541.378577:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1787602541.378650:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db7b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.378667:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db7b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.378680:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db7b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.378689:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db7b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.378695:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db7b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.378711:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db7b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602541.379645:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787602541.379821:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+17:10447:x1874436833717632:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 5120us (6035us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1787602541.379832:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00000020:00080000:1.0:1787602541.379838:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787602541.382989:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602541.383003:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db7b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.383014:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eae00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:3.0:1787602541.383137:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db7b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.383148:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db7b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.383167:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d350cd81f00) 00010000:00010000:3.0:1787602541.383339:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787602541.383346:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db7b3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602541.383353:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db7b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602541.383523:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602541.383526:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602541.383529:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602541.677453:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602541.677472:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d4b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853664128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602541.677543:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602541.677655:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853664128 00000100:00100000:2.0:1787602541.677662:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853664128 00000100:00100000:2.0:1787602541.677702:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787602541.677719:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874436853664128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602541.677766:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787602541.677912:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874436853664128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 201us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602541.677920:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787602541.678042:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d4b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853664128:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787602542.256581:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787602543.096029:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787602543.096039:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787602543.096085:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787602543.096090:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787602543.274628:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602543.274822:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833717888 00000100:00100000:1.0:1787602543.274844:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833717888 00000100:00100000:1.0:1787602543.274923:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 84 00000100:00100000:1.0:1787602543.274935:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+17:10465:x1874436833717888:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787602543.274963:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602543.274987:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db7ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2482 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787602543.275287:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787602543.275296:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db7c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.275312:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db7c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.275327:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db7c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602543.275339:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787602543.275541:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db7ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2482 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.275567:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db7c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2482 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.275576:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:1.0:1787602543.275579:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787602543.275584:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eb400, rc 0) 00000100:00100000:1.0:1787602543.275658:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+19:10465:x1874436833717888:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 725us (1042us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787602543.275666:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 84 00010000:00010000:0.0:1787602543.278889:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602543.285653:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602543.286946:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833718016 00000100:00100000:2.0:1787602543.286961:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833718016 00000100:00100000:2.0:1787602543.287029:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 85 00000100:00100000:2.0:1787602543.287041:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+19:10465:x1874436833718016:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:2.0:1787602543.287122:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db7cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.287207:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db7cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.287222:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db7cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.287238:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.287245:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.287252:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.287786:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db7dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.287797:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db7dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.287805:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db7dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602543.287855:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db7dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.287869:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db7cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.287883:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db7cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.287891:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db7cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.287897:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602543.288201:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db7cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288211:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db7cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288226:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:2.0:1787602543.288230:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602543.288234:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db7cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288240:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db7cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288253:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288259:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288265:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288269:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602543.288280:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288286:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288294:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3504d95c00) 00010000:00010000:2.0:1787602543.288296:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602543.288298:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288304:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db7d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288319:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db7dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288326:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db7dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288332:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db7dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288337:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602543.288340:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db7dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288346:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db7dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288353:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d3504d95400) 00010000:00010000:2.0:1787602543.288355:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602543.288362:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db7dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.288368:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db7dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602543.289242:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+19:10465:x1874436833718016:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 2193us (3590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602543.289254:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 85 00000001:00080000:0.0:1787602543.331766:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:0.0:1787602543.331787:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1787602543.362862:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602543.364167:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833718272 00000100:00100000:1.0:1787602543.364179:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833718272 00000100:00100000:1.0:1787602543.364232:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 86 00000100:00100000:1.0:1787602543.364242:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+19:10468:x1874436833718272:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787602543.364261:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602543.364283:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db7e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2489 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.364357:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db7eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.364372:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db7eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.364383:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db7eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.364397:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db7f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.364411:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db7f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.364417:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db7f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.365378:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09db7f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.365393:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09db7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.365403:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09db7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602543.365415:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787602543.366680:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db7eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.367225:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db7eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.367233:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db7eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.367240:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602543.367244:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db7eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.367252:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db7eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.367280:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:1.0:1787602543.367283:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602543.367288:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db7eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.367294:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db7eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.367307:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db7f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.367313:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db7f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.367318:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db7f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.367324:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ebe00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602543.367327:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db7f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.367333:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db7f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.367340:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d350cd81500) 00010000:00010000:1.0:1787602543.367342:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602543.367345:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db7f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.367351:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db7f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.367422:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db7e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2489 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.367437:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09db7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2489 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.367444:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81000) 00010000:00010000:1.0:1787602543.367447:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602543.367449:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eb600, rc 0) 00000100:00100000:1.0:1787602543.367895:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+21:10468:x1874436833718272:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 3651us (5038us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787602543.367974:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 86 00000100:00100000:0.0:1787602543.377859:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602543.377930:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833718400 00000100:00100000:3.0:1787602543.377941:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833718400 00000100:00100000:3.0:1787602543.378005:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 87 00000100:00100000:3.0:1787602543.378026:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+21:10468:x1874436833718400:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:3.0:1787602543.378103:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db807 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.378121:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.378132:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.378160:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.378168:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db807 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.378175:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.378181:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602543.378186:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.378194:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db807 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.378215:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81000) 00010000:00010000:3.0:1787602543.378218:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787602543.378224:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db807 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.378231:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09db807 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602543.378298:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+21:10468:x1874436833718400:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 275us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602543.378306:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 87 00000100:00100000:2.0:1787602543.386279:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602543.386349:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833718656 00000100:00100000:3.0:1787602543.386359:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833718656 00000100:00100000:3.0:1787602543.386421:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:3.0:1787602543.386431:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35079d2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+21:10468:x1874436833718656:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:3.0:1787602543.387139:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35079d2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+22:10468:x1874436833718656:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 704us (866us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787602543.387148:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:3.0:1787602543.423853:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602543.424025:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833718912 00000100:00100000:2.0:1787602543.424036:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833718912 00000100:00100000:2.0:1787602543.424099:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 88 00000100:00100000:2.0:1787602543.424111:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+22:9988:x1874436833718912:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787602543.424137:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602543.424161:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db80e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2490 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.424284:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db815 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.424299:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09db7f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2489 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.424309:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db815 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.424348:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09db7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2489 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.424384:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09db7f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2489 expref: 23 pid: 5837 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602543.424399:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d48a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874436853664256:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602543.424500:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503569d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787602543.426672:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602543.426998:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833719040 00000100:00100000:0.0:1787602543.427009:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833719040 00010000:00010000:0.0:1787602543.427055:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09db7f9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2489 expref: 24 pid: 5837 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602543.427097:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:0.0:1787602543.427108:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+24:2352:x1874436833719040:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602543.427123:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602543.427130:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09db7f9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2489 expref: 24 pid: 5837 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.427144:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09db7f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2489 expref: 24 pid: 5837 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.427170:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81000) 00010000:00010000:0.0:1787602543.427188:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db815 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.427199:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db815 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.427207:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db815 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.427229:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602543.427295:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+24:2352:x1874436833719040:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 187us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602543.427303:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 47 00010000:00010000:2.0:1787602543.427885:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09db7f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2489 expref: 23 pid: 5837 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602543.427908:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d48a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874436853664256:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602543.427931:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db815 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.427941:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db815 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.427947:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db815 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602543.427972:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787602543.428162:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09db80e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2490 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.428178:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db815 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2490 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.428186:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81000) 00010000:00010000:2.0:1787602543.428200:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787602543.428203:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4200, rc 0) 00000100:00100000:2.0:1787602543.428266:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+23:9988:x1874436833718912:12345-192.168.201.26@tcp:101:bash.0 Request processed in 4156us (4424us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787602543.428273:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 88 00000100:00100000:3.0:1787602543.433438:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602543.433490:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833719296 00000100:00100000:2.0:1787602543.433512:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833719296 00000100:00100000:2.0:1787602543.433577:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 89 00000100:00100000:2.0:1787602543.433589:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+23:9988:x1874436833719296:12345-192.168.201.26@tcp:36:bash.0 00010000:00010000:2.0:1787602543.433967:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db823 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.433985:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.433998:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602543.434052:0:8208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787602543.434078:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b893d21d reply state 00000000fda0c065 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602543.434087:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787602543.434132:0:8208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787602543.434926:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+27:9988:x1874436833719296:12345-192.168.201.26@tcp:36:bash.0 Request processed in 1334us (1494us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787602543.434935:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 89 00000020:00080000:2.0:1787602543.434940:0:8208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787602543.437719:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602543.437938:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833719424 00000100:00100000:0.0:1787602543.437950:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833719424 00000100:00100000:0.0:1787602543.438004:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 90 00000100:00100000:0.0:1787602543.438021:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d48a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+27:9988:x1874436833719424:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:0.0:1787602543.438047:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602543.438070:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db82a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2497 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.438136:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db82a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2497 expref: 28 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.438152:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db82a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2497 expref: 28 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.438173:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81000) 00010000:00010000:0.0:1787602543.438177:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787602543.438194:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e3c00, rc 0) 00000100:00100000:0.0:1787602543.438259:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d48a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+28:9988:x1874436833719424:12345-192.168.201.26@tcp:101:bash.0 Request processed in 239us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602543.438266:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 90 00010000:00010000:1.0:1787602543.438652:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.438853:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db823 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.438861:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db823 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.438867:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602543.438873:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db823 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.438881:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db823 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.438895:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81000) 00010000:00010000:1.0:1787602543.438905:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602543.438910:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db823 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.438916:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09db823 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602543.448453:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602543.448541:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833719552 00000100:00100000:0.0:1787602543.448551:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833719552 00000100:00100000:0.0:1787602543.448714:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:0.0:1787602543.448728:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:9988:x1874436833719552:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:0.0:1787602543.448790:0:8625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602543.448818:0:8625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf834878/0x3640686da09db831 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c249e expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787602543.448852:0:8625:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8ca66c, atime: 0x6a8ca66a, ctime: 0x6a8ca66c, blocks: 0xb 00010000:00010000:0.0:1787602543.448877:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=328s v=(0 0) 00010000:00010000:0.0:1787602543.448883:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602543.448892:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf834878/0x3640686da09db831 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c249e expref: 7 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.448912:0:8625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf834878/0x3640686da09db831 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c249e expref: 7 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.448926:0:8625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2400, rc 0) 00000100:00100000:0.0:1787602543.448987:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:9988:x1874436833719552:12345-192.168.201.26@tcp:101:bash.0 Request processed in 262us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602543.448994:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00080000:3.0:1787602543.449599:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787602543.452068:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602543.452182:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833719680 00000100:00100000:2.0:1787602543.452205:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833719680 00002000:00010000:2.0:1787602543.452245:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787602543.452249:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d353d4b5f80 with x1874436833719680 ext(0->18446744073709551615) 00002000:00010000:2.0:1787602543.452261:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d353d4b5f80. 00000100:00100000:2.0:1787602543.452293:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:2.0:1787602543.452303:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2352:x1874436833719680:12345-192.168.201.26@tcp:10:bash.0 00002000:00010000:2.0:1787602543.452602:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787602543.452606:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787602540 -> 1787602544 00002000:00010000:2.0:1787602543.452609:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787602538 -> 1787602538 00002000:00010000:2.0:1787602543.452611:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787602540 -> 1787602544 00002000:00010000:2.0:1787602543.452614:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787602543.452676:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2352:x1874436833719680:12345-192.168.201.26@tcp:10:bash.0 Request processed in 374us (618us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787602543.452697:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 1 00002000:00010000:2.0:1787602543.452701:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787602543.452704:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d353d4b5f80 with x1874436833719680 ext(0->18446744073709551615) 00002000:00010000:2.0:1787602543.452708:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d353d4b5f80. 00000100:00100000:1.0:1787602543.560154:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602543.560799:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833719808 00000100:00100000:0.0:1787602543.560811:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833719808 00000100:00100000:0.0:1787602543.560906:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 91 00000100:00100000:0.0:1787602543.560918:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+27:10482:x1874436833719808:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:0.0:1787602543.560994:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db838 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.561152:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db838 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.561165:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db838 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.561183:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db83f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.561191:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db83f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.561197:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db83f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.562198:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db846 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.562211:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.562294:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787602543.562344:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.562355:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db838 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.562370:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db838 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.562377:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db838 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.562383:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602543.562387:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db838 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.562395:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db838 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.562407:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:0.0:1787602543.562410:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602543.562415:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db838 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.562420:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db838 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.562435:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db83f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.562441:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db83f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.562447:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db83f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.562452:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602543.563428:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db83f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.563440:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db83f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.563457:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d350b502f00) 00010000:00010000:0.0:1787602543.563473:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602543.563477:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db83f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.563483:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db83f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.563513:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.563520:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db846 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.563525:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.563530:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602543.563532:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.563538:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db846 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.563545:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81000) 00010000:00010000:0.0:1787602543.563547:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602543.563564:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db846 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.563570:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db846 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602543.563690:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+27:10482:x1874436833719808:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 2759us (3532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602543.563701:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 91 00000100:00100000:0.0:1787602543.648241:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602543.648428:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833720064 00000100:00100000:1.0:1787602543.648438:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833720064 00000100:00100000:1.0:1787602543.648506:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 92 00000100:00100000:1.0:1787602543.648516:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+27:10485:x1874436833720064:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787602543.648535:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602543.648556:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db84d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c24a5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.648650:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db854 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.648667:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db854 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.648686:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db854 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.648702:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09db85b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.648708:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09db85b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.648714:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09db85b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.649997:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb800/0x3640686da09db862 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650198:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb800/0x3640686da09db862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650210:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb800/0x3640686da09db862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602543.650224:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787602543.650331:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db854 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650339:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db854 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650346:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db854 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650352:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602543.650357:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db854 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650364:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db854 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650379:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:1.0:1787602543.650382:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602543.650387:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db854 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650406:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09db854 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650420:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09db85b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650426:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09db85b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650432:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09db85b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650436:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602543.650439:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09db85b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650445:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09db85b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650452:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d350cd81500) 00010000:00010000:1.0:1787602543.650454:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602543.650457:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09db85b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650473:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09db85b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650516:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09db84d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24a5 expref: 30 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650528:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb800/0x3640686da09db862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24a5 expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.650541:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81000) 00010000:00010000:1.0:1787602543.650544:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787602543.650546:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eb800, rc 0) 00000100:00100000:1.0:1787602543.650692:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+29:10485:x1874436833720064:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 2165us (2449us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787602543.650701:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 92 00000100:00100000:3.0:1787602543.660829:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602543.661084:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833720192 00000100:00100000:2.0:1787602543.661095:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833720192 00000100:00100000:2.0:1787602543.661155:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 93 00000100:00100000:2.0:1787602543.661167:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+29:10485:x1874436833720192:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:2.0:1787602543.661237:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db870 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.661254:0:8208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db815 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2490 expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.661280:0:8208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db870 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.661317:0:8208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db815 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2490 expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.661331:0:8208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db815 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2490 expref: 29 pid: 5837 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602543.661345:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d48b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853664384:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602543.661550:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3507ce3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787602543.668456:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d48b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853664384:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602543.668494:0:8208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db870 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602543.673963:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602543.674180:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833720448 00000100:00100000:2.0:1787602543.674191:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833720448 00000100:00100000:2.0:1787602543.674249:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:2.0:1787602543.674259:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+30:5591:x1874436833720448:12345-192.168.201.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787602543.675032:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+31:5591:x1874436833720448:12345-192.168.201.26@tcp:35:ldlm_bl.0 Request processed in 771us (1078us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787602543.675042:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:2.0:1787602543.678391:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602543.679298:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833720576 00000100:00100000:3.0:1787602543.679309:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833720576 00010000:00010000:3.0:1787602543.679357:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db815 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2490 expref: 31 pid: 5837 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602543.679449:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:3.0:1787602543.679471:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d48bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+31:2351:x1874436833720576:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602543.679496:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602543.679504:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db815 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2490 expref: 31 pid: 5837 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.679519:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db815 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2490 expref: 31 pid: 5837 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.679541:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09db815 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2490 expref: 31 pid: 5837 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.679558:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81000) 00010000:00010000:3.0:1787602543.679563:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db870 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.679572:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.679579:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db870 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.679644:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602543.679985:0:8208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.679994:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.680036:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.680043:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db870 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.680050:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.680055:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602543.680060:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.680067:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db870 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.680077:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81000) 00010000:00010000:0.0:1787602543.680086:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602543.680091:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db870 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.680096:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09db870 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602543.680214:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d48bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+30:2351:x1874436833720576:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 755us (1830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602543.680223:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:0.0:1787602543.683258:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+29:10485:x1874436833720192:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 22080us (22429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602543.683272:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 93 00000100:00100000:3.0:1787602543.687258:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602543.687344:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833720832 00000100:00100000:2.0:1787602543.687355:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833720832 00000100:00100000:2.0:1787602543.687408:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:2.0:1787602543.687420:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+29:10485:x1874436833720832:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:2.0:1787602543.687981:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+30:10485:x1874436833720832:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 560us (730us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787602543.688004:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:1.0:1787602543.841271:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602543.841649:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833721088 00000100:00100000:2.0:1787602543.841662:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833721088 00000100:00100000:2.0:1787602543.841783:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 94 00000100:00100000:2.0:1787602543.841795:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+30:10496:x1874436833721088:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:2.0:1787602543.841821:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602543.841844:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db877 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c24ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.841937:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db87e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.841952:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db87e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.841964:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db87e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.841978:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db885 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.841986:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.841993:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.842859:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db88c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.842882:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db88c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.842891:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db88c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602543.843363:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787602543.843984:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db87e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.843994:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db87e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.844071:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db87e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.844078:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602543.844083:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db87e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.844090:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db87e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.844106:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:2.0:1787602543.844109:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602543.844113:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db87e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.844119:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db87e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.844134:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.844152:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db885 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.844334:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db885 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.844340:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602543.844343:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db885 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.844350:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db885 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.844358:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3504d95400) 00010000:00010000:2.0:1787602543.844361:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602543.844364:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db885 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.844370:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db885 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.844430:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db877 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24ac expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.844446:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db88c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24ac expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.844453:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81000) 00010000:00010000:2.0:1787602543.844569:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602543.844581:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4e00, rc 0) 00000100:00100000:2.0:1787602543.844786:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+32:10496:x1874436833721088:12345-192.168.201.26@tcp:101:cat.0 Request processed in 2945us (3478us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787602543.844797:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 94 00000100:00100000:3.0:1787602543.853409:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602543.853550:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833721344 00000100:00100000:2.0:1787602543.853562:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833721344 00000100:00100000:2.0:1787602543.854448:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:2.0:1787602543.854470:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+32:10496:x1874436833721344:12345-192.168.201.26@tcp:35:cat.0 00000100:00100000:2.0:1787602543.854774:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+33:10496:x1874436833721344:12345-192.168.201.26@tcp:35:cat.0 Request processed in 316us (1375us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787602543.854782:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:3.0:1787602543.883336:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602543.883619:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833721600 00000100:00100000:0.0:1787602543.883631:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833721600 00000100:00100000:0.0:1787602543.883706:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 95 00000100:00100000:0.0:1787602543.883718:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+33:10497:x1874436833721600:12345-192.168.201.26@tcp:36:rm.0 00010000:00010000:0.0:1787602543.883836:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787602543.883866:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09db88c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24ac expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.883889:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb800/0x3640686da09db862 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24a5 expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.883913:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db82a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2497 expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.883924:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350cd81000) 00010000:00010000:0.0:1787602543.883934:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602543.883955:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db89a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.883983:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db89a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.883992:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db89a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.884006:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db8a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.884013:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db8a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.884019:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db8a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.884360:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db8a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.884368:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db8a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.884375:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db8a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787602543.885103:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1787602543.885113:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328831369057ns, next at 329831366617ns, rc = 0 00010000:00010000:0.0:1787602543.885177:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2200/0x3640686da09db8af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885187:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2200/0x3640686da09db8af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885206:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2200/0x3640686da09db8af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885213:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2200/0x3640686da09db8af lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885218:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2200/0x3640686da09db8af lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885224:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2200/0x3640686da09db8af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885243:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787602543.885265:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db8a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885271:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db8a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885276:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db8a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885281:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602543.885286:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db8a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885292:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db8a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885302:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502d00) 00010000:00010000:0.0:1787602543.885305:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787602543.885314:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db8a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885320:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db8a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885337:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db89a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885343:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db89a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885347:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db89a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885352:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602543.885355:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db89a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885360:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db89a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885368:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:0.0:1787602543.885371:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602543.885374:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db89a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.885380:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09db89a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787602543.885389:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000676a1516 reply state 000000000369c71a transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db8a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602543.885408:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602543.885494:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+32:10497:x1874436833721600:12345-192.168.201.26@tcp:36:rm.0 Request processed in 1775us (2166us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787602543.885501:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 95 00010000:00010000:2.0:1787602543.885926:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602543.885934:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2200/0x3640686da09db8af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.885940:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e2200 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602543.885944:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2200/0x3640686da09db8af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.885950:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2200/0x3640686da09db8af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.885960:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d350b502d00) 00010000:00010000:2.0:1787602543.885963:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787602543.885965:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2200/0x3640686da09db8af lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.885970:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2200/0x3640686da09db8af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602543.886000:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602543.886002:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602543.886004:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602543.897182:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db8a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.897203:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db8a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.897212:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db8a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.897230:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602543.897236:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db8a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.897244:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db8a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.897264:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d350b502f00) 00010000:00010000:3.0:1787602543.897267:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602543.897272:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db8a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.897278:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db8a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602543.974909:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602543.975014:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833721856 00000100:00100000:1.0:1787602543.975025:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833721856 00000100:00100000:1.0:1787602543.975088:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 96 00000100:00100000:1.0:1787602543.975100:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+31:10503:x1874436833721856:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787602543.975130:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602543.975155:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db8b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c24b3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.975309:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db8bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.975325:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db8bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.975338:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db8bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.975353:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db8c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.975360:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db8c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.975383:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db8c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787602543.976038:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787602543.976233:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db8cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.976244:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db8cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.976252:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db8cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.976288:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db8bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.976295:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db8bd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.976302:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db8bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.976307:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eba00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602543.976312:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db8bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.976319:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db8bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.976333:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:1.0:1787602543.976336:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602543.976350:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db8bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.976356:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09db8bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602543.976372:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c99faf66 reply state 0000000029992dcf transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db8c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602543.976382:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787602543.976421:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db8b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24b3 expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.976436:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db8cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24b3 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602543.976445:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d350cd81800) 00010000:00010000:1.0:1787602543.976447:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602543.976450:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354ebc00, rc 0) 00000100:00100000:1.0:1787602543.976560:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+34:10503:x1874436833721856:12345-192.168.201.26@tcp:101:bash.0 Request processed in 1461us (1670us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787602543.976569:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 96 00000100:00100000:1.0:1787602543.982739:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602543.983485:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833721984 00000100:00100000:3.0:1787602543.983497:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833721984 00000100:00100000:3.0:1787602543.983592:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 34 00000100:00100000:3.0:1787602543.983604:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2351:x1874436833721984:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:3.0:1787602543.984165:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602543.984194:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b484c9a4/0x3640686da09db8d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c24ba expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787602543.984240:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787602543.984264:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=328s v=(0 0) 00010000:00010000:3.0:1787602543.984269:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602543.984283:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b484c9a4/0x3640686da09db8d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24ba expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.984305:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b484c9a4/0x3640686da09db8d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24ba expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.984319:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432400, rc 0) 00000100:00100000:3.0:1787602543.984384:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2351:x1874436833721984:12345-192.168.201.26@tcp:101:bash.0 Request processed in 782us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602543.984391:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 34 00000100:00080000:1.0:1787602543.988157:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787602543.988299:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602543.988447:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833722112 00000100:00100000:3.0:1787602543.988470:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833722112 00000100:00100000:3.0:1787602543.988533:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:3.0:1787602543.988543:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:10503:x1874436833722112:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:3.0:1787602543.988579:0:8625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602543.988602:0:8625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c24c1 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.988636:0:8625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b484c9a4/0x3640686da09db8d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24ba expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.988647:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602543.988651:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602543.988656:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c1 expref: 7 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.988704:0:8625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b484c9a4/0x3640686da09db8d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24ba expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.988719:0:8625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b484c9a4/0x3640686da09db8d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24ba expref: 7 pid: 6689 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602543.988734:0:8625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d4b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1874436853664512:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787602543.988860:0:8625:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af52300 going to sleep for 11 seconds 00010000:00010000:0.0:1787602543.990494:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db8c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.990509:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db8c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.990516:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db8c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.990522:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eac00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602543.990528:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db8c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.990535:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db8c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.990554:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d350cd81500) 00010000:00010000:0.0:1787602543.990558:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602543.990564:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db8c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.990570:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09db8c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602543.993842:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602543.993947:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833722240 00000100:00100000:0.0:1787602543.993958:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833722240 00010000:00010000:0.0:1787602543.994036:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b484c9a4/0x3640686da09db8d9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24ba expref: 8 pid: 6689 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602543.994083:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:0.0:1787602543.994094:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3509d54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2351:x1874436833722240:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602543.994110:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602543.994134:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b484c9a4/0x3640686da09db8d9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24ba expref: 8 pid: 6689 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.994148:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b484c9a4/0x3640686da09db8d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24ba expref: 8 pid: 6689 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.994174:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602543.994178:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602543.994187:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c1 expref: 8 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.994196:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c1 expref: 8 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602543.994253:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c1 expref: 8 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602543.994268:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35357d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1874436853664640:192.168.201.26@tcp:105: 00000100:00100000:0.0:1787602543.994346:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32240 going to sleep for 11 seconds 00010000:00010000:3.0:1787602543.994796:0:8625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b484c9a4/0x3640686da09db8d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24ba expref: 8 pid: 6689 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602543.994812:0:8625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d4b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1874436853664512:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602543.994836:0:8625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c1 expref: 7 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602543.994856:0:8625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432200, rc 0) 00000100:00100000:3.0:1787602543.994906:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:10503:x1874436833722112:12345-192.168.201.26@tcp:101:bash.0 Request processed in 6363us (6613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602543.994913:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:0.0:1787602544.003527:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35357d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1874436853664640:192.168.201.26@tcp:105: 00010000:00010000:0.0:1787602544.003585:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602544.003645:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3509d54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2351:x1874436833722240:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 9552us (9812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602544.003657:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:1.0:1787602544.008178:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602544.008275:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833722496 00000100:00100000:2.0:1787602544.008287:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833722496 00000100:00100000:2.0:1787602544.008353:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:2.0:1787602544.008363:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+33:10503:x1874436833722496:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:2.0:1787602544.008795:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+34:10503:x1874436833722496:12345-192.168.201.26@tcp:35:bash.0 Request processed in 432us (626us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787602544.008803:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:2.0:1787602544.237029:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d48a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853665024:0@lo:400:kworker.0 00000100:00100000:2.0:1787602544.237102:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602544.237182:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787602544.237189:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874436853664896:0@lo:400:kworker.0 00000100:00100000:2.0:1787602544.237210:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602544.237226:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d48bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853665408:0@lo:400:kworker.0 00000100:00100000:2.0:1787602544.237251:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602544.237288:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853665408 00000100:00100000:2.0:1787602544.237296:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853665408 00000100:00100000:2.0:1787602544.237351:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787602544.237359:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853665408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602544.237416:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853665408:12345-0@lo:400:kworker.0 Request processed in 57us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602544.237440:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787602544.237480:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1787602544.237486:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1787602544.237507:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d353d489180, transno 4294967301 00000100:00100000:2.0:1787602544.237520:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d48bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853665408:0@lo:400:kworker.0 00000100:00100000:0.0:1787602544.237930:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853664768:0@lo:400:kworker.0 00000100:00100000:0.0:1787602544.237970:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602544.238006:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d48aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853665280:0@lo:400:kworker.0 00000100:00100000:0.0:1787602544.238032:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602544.238053:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602544.238059:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853665152:0@lo:400:kworker.0 00000100:00100000:0.0:1787602544.238081:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602544.238111:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853665152 00000100:00100000:0.0:1787602544.238116:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853665152 00000100:00100000:0.0:1787602544.238147:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787602544.238156:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1874436853665152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602544.238195:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1874436853665152:12345-0@lo:400:kworker.0 Request processed in 42us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602544.238202:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787602544.238232:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853665152:0@lo:400:kworker.0 00000100:00100000:0.0:1787602544.238250:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853665024 00000100:00100000:0.0:1787602544.238253:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853665024 00000100:00100000:0.0:1787602544.238281:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853664896 00000100:00100000:0.0:1787602544.238284:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853664896 00000100:00100000:0.0:1787602544.238296:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853665280 00000100:00100000:0.0:1787602544.238299:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853665280 00000100:00100000:0.0:1787602544.238313:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787602544.238320:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d48b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853665024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602544.238368:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d48b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853665024:12345-0@lo:400:kworker.0 Request processed in 48us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602544.238375:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787602544.238389:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787602544.238395:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874436853664896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602544.238422:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874436853664896:12345-0@lo:400:kworker.0 Request processed in 28us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602544.238427:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787602544.238438:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787602544.238446:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853665280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602544.238479:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853665280:12345-0@lo:400:kworker.0 Request processed in 35us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602544.238484:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787602544.238507:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d48aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853665280:0@lo:400:kworker.0 00000100:00100000:0.0:1787602544.238531:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874436853664896:0@lo:400:kworker.0 00000100:00100000:0.0:1787602544.238541:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d48a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853665024:0@lo:400:kworker.0 00000100:00100000:2.0:1787602544.238622:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853664768 00000100:00100000:2.0:1787602544.238626:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853664768 00000100:00100000:2.0:1787602544.238661:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787602544.238677:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853664768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602544.238716:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853664768:12345-0@lo:400:kworker.0 Request processed in 49us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602544.238723:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787602544.238776:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853664768:0@lo:400:kworker.0 00000100:00080000:1.0:1787602544.238917:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787602544.238923:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602544.238926:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787602544.282516:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602544.282616:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833722624 00000100:00100000:0.0:1787602544.282627:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833722624 00000100:00100000:0.0:1787602544.282709:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 97 00000100:00100000:0.0:1787602544.282722:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+34:10519:x1874436833722624:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602544.282788:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602544.282812:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db8e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c24c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.282903:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db8ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.282916:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db8ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.282929:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db8ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602544.282989:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787602544.282993:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602544.283015:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db8ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.283040:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db8e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c8 expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.283058:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db8ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c8 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.283067:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:0.0:1787602544.283071:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787602544.283075:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e3c00, rc 0) 00000100:00100000:0.0:1787602544.283140:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+35:10519:x1874436833722624:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 421us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602544.283147:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 97 00000100:00100000:0.0:1787602544.292459:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602544.292552:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833722880 00000100:00100000:3.0:1787602544.292563:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833722880 00000100:00100000:3.0:1787602544.292626:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 98 00000100:00100000:3.0:1787602544.292637:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+35:10519:x1874436833722880:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602544.292658:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602544.292692:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db8f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c24cf expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.292859:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db8fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.292874:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.292886:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602544.292897:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787602544.293058:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db8f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24cf expref: 38 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.293077:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db8fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24cf expref: 37 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.293107:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d350cd81800) 00010000:00010000:3.0:1787602544.293110:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602544.293114:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432000, rc 0) 00000100:00100000:3.0:1787602544.293240:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+37:10519:x1874436833722880:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 604us (790us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787602544.293247:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 98 00010000:00010000:1.0:1787602544.300922:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602544.315544:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602544.315593:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602544.315717:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833723008 00000100:00100000:2.0:1787602544.315728:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833723008 00000100:00100000:2.0:1787602544.315878:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:2.0:1787602544.315890:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+37:2352:x1874436833723008:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602544.315906:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602544.315932:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09db8fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24cf expref: 37 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.315951:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d350cd81800) 00010000:00010000:2.0:1787602544.315956:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602544.316132:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+36:2352:x1874436833723008:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 243us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602544.316153:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:0.0:1787602544.317610:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833723264 00000100:00100000:0.0:1787602544.317636:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833723264 00000100:00100000:0.0:1787602544.317702:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 99 00000100:00100000:0.0:1787602544.317714:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+36:10519:x1874436833723264:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602544.317918:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602544.317944:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db90a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c24d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.318140:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db911 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.318157:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db911 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.318169:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db911 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602544.318183:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787602544.318318:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09db90a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24d6 expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.318337:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db911 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24d6 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.318347:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d350cd81800) 00010000:00010000:0.0:1787602544.318350:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787602544.318354:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2000, rc 0) 00000100:00100000:0.0:1787602544.318462:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+38:10519:x1874436833723264:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 750us (2868us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787602544.318470:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 99 00000100:00100000:1.0:1787602544.331417:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602544.331516:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833723392 00000100:00100000:2.0:1787602544.331526:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833723392 00000100:00100000:2.0:1787602544.331620:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:2.0:1787602544.331631:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2351:x1874436833723392:12345-192.168.201.26@tcp:1:lfs.0 00010000:00010000:2.0:1787602544.331686:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09db91f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.331707:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c1 expref: 6 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.331716:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787602544.331720:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602544.331725:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09db91f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.331953:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c1 expref: 6 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.331968:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c1 expref: 6 pid: 8625 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602544.331983:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35357df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1874436853665536:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602544.332089:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353976fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602544.335290:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35357df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1874436853665536:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602544.335327:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09db91f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602544.339088:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602544.339697:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833723520 00000100:00100000:3.0:1787602544.339710:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833723520 00002000:00100000:3.0:1787602544.339815:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d35357df800 x1874436833723520/t0(0) o4->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:380/0 lens 504/0 e 0 to 0 dl 1787602555 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787602544.339827:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d35357df800 with x1874436833723520 ext(0->8) 00010000:00010000:3.0:1787602544.339838:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c1 expref: 7 pid: 8625 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.339855:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c1 expref: 7 pid: 8625 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787602544.339863:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d35357df800 00000100:00100000:3.0:1787602544.339909:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:3.0:1787602544.339920:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833723520:12345-192.168.201.26@tcp:4:lfs.0 00000100:00100000:3.0:1787602544.340659:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+9:2351:x1874436833723520:12345-192.168.201.26@tcp:4:lfs.0 Request processed in 739us (1580us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787602544.340677:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 1 00002000:00100000:3.0:1787602544.340685:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d35357df800 x1874436833723520/t4294967302(0) o4->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:380/0 lens 504/448 e 0 to 0 dl 1787602555 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787602544.340701:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d35357df800 with x1874436833723520 ext(0->8) 00010000:00010000:3.0:1787602544.340708:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c1 expref: 9 pid: 8625 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.340721:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c1 expref: 9 pid: 8625 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787602544.340729:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d35357df800 00000100:00100000:2.0:1787602544.345378:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602544.345528:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833723648 00000100:00100000:0.0:1787602544.345539:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833723648 00010000:00010000:0.0:1787602544.345584:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c1 expref: 9 pid: 8625 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602544.345629:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 50 00000100:00100000:0.0:1787602544.345639:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d488000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+9:2353:x1874436833723648:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602544.345655:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787602544.345688:0:11167:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787602544.345691:0:11167:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787602545 00002000:00010000:0.0:1787602544.345694:0:11167:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787602545 00002000:00010000:0.0:1787602544.345696:0:11167:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787602545 00010000:00010000:0.0:1787602544.345702:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c1 expref: 9 pid: 8625 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.345718:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c1 expref: 9 pid: 8625 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.345787:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cabc890f/0x3640686da09db8e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c1 expref: 9 pid: 8625 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.345808:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602544.345813:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602544.345820:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09db91f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.345831:0:11167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09db91f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.345874:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602544.345984:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d488000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2353:x1874436833723648:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 345us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602544.345992:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 50 00010000:00010000:1.0:1787602544.346199:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09db91f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.346210:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09db91f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.346248:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09db91f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.346256:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09db91f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.346273:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09db91f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.346280:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5e00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602544.346284:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09db91f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.346293:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09db91f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.346306:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09db91f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.346313:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09db91f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602544.346367:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833723392:12345-192.168.201.26@tcp:1:lfs.0 Request processed in 14737us (14961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602544.346375:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:2.0:1787602544.352199:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602544.352290:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833723904 00000100:00100000:1.0:1787602544.352303:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833723904 00000100:00100000:1.0:1787602544.352376:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00100000:1.0:1787602544.352387:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35079d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+38:10519:x1874436833723904:12345-192.168.201.26@tcp:35:lfs.0 00000004:00010000:1.0:1787602544.352455:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db911 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24d6 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787602544.352796:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1787602544.352849:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1787602544.353337:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1787602544.353394:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db926 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.353410:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db8cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24b3 expref: 42 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.353420:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db926 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.353459:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db8cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24b3 expref: 42 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.353474:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db8cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24b3 expref: 42 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602544.353489:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35357dfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1874436853665664:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602544.353570:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353976fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602544.357529:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602544.357680:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35357dfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1874436853665664:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602544.357709:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db926 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602544.357911:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833724032 00000100:00100000:3.0:1787602544.357919:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833724032 00010000:00010000:3.0:1787602544.357958:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db8cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24b3 expref: 43 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602544.358096:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:3.0:1787602544.358107:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d489180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+43:2351:x1874436833724032:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602544.358123:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602544.358130:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db8cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24b3 expref: 43 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.358143:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db8cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24b3 expref: 43 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.358164:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09db8cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24b3 expref: 43 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.358181:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d350cd81800) 00010000:00010000:3.0:1787602544.358199:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db926 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.358209:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db926 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.358229:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db926 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.358256:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602544.358354:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d489180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+42:2351:x1874436833724032:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 248us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602544.358363:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 51 00010000:00010000:1.0:1787602544.358468:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db926 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.358476:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db926 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787602544.358617:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787602544.358870:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787602544.358981:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35357dfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874436853665792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787602544.359047:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602544.359083:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353976fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787602544.360721:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853665792 00000100:00100000:0.0:1787602544.360769:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853665792 00000100:00100000:0.0:1787602544.360836:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787602544.360847:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1874436853665792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787602544.360963:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1874436853665792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 117us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602544.360970:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602544.361261:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35357dfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874436853665792:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787602544.361924:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1787602544.362317:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d48bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874436853665920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787602544.362378:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602544.362447:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353976fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787602544.364972:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853665920 00000100:00100000:0.0:1787602544.364987:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853665920 00000100:00100000:1.0:1787602544.367385:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787602544.367401:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1874436853665920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787602544.368354:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1874436853665920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 953us (5971us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787602544.368365:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787602544.370126:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d48bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874436853665920:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787602544.373091:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1787602544.373200:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db926 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.373333:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db926 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.373343:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db926 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.373349:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eae00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602544.373354:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db926 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.373362:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db926 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.373379:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d350cd81800) 00010000:00010000:2.0:1787602544.373383:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787602544.373388:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db926 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.373394:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09db926 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787602544.374196:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787602544.375084:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1787602544.375107:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329321362666ns, next at 330321358299ns, rc = 0 00000001:00080000:2.0:1787602544.375122:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1787602544.375189:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d350cd81800) 00010000:00010000:2.0:1787602544.375194:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787602544.375399:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09db911 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24d6 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602544.376441:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35079d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+45:10519:x1874436833723904:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 24049us (24248us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1787602544.376460:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 26 00000020:00080000:2.0:1787602544.376466:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787602544.384832:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602544.384916:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833724160 00000100:00100000:3.0:1787602544.384927:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833724160 00000100:00100000:3.0:1787602544.385005:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 100 00000100:00100000:3.0:1787602544.385016:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d48a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+45:10519:x1874436833724160:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602544.385041:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602544.385064:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db92d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c24dd expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.385128:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db92d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24dd expref: 46 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.385143:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db92d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24dd expref: 46 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.385161:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:3.0:1787602544.385164:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602544.385183:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432400, rc 0) 00000100:00100000:3.0:1787602544.385238:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d48a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+46:10519:x1874436833724160:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 224us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602544.385245:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 100 00000100:00100000:1.0:1787602544.388915:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602544.389081:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833724416 00000100:00100000:3.0:1787602544.389094:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833724416 00000100:00100000:3.0:1787602544.389200:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 27 00000100:00100000:3.0:1787602544.389210:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+46:10519:x1874436833724416:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:3.0:1787602544.389507:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+47:10519:x1874436833724416:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 298us (602us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787602544.389515:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 27 00000100:00100000:0.0:1787602544.504933:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602544.505048:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833724544 00000100:00100000:2.0:1787602544.505059:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833724544 00000100:00100000:2.0:1787602544.505125:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 101 00000100:00100000:2.0:1787602544.505135:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+47:10529:x1874436833724544:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:2.0:1787602544.505220:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09db934 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505237:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09db934 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505250:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09db934 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505267:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db93b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505276:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db93b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505282:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db93b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505387:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db942 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505410:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505418:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602544.505462:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505475:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09db934 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505480:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09db934 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505487:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09db934 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505493:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602544.505497:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09db934 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505505:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09db934 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505518:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:2.0:1787602544.505521:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602544.505526:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09db934 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505532:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09db934 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505554:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db93b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505559:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db93b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505565:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db93b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505571:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602544.505574:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db93b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505580:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db93b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505588:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3504d95400) 00010000:00010000:2.0:1787602544.505591:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602544.505593:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db93b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505599:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db93b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505612:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db942 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505619:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db942 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505625:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db942 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505637:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602544.505640:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db942 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505646:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db942 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505654:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:2.0:1787602544.505656:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602544.505659:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db942 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.505677:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db942 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602544.506141:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+47:10529:x1874436833724544:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 1005us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602544.506151:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 101 00000100:00100000:1.0:1787602544.555221:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602544.555316:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833724800 00000100:00100000:3.0:1787602544.555327:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833724800 00000100:00100000:3.0:1787602544.555387:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 102 00000100:00100000:3.0:1787602544.555398:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+47:10532:x1874436833724800:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602544.555421:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602544.555444:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db949 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c24e4 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.555529:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db950 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.555543:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db950 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.555555:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db950 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.555569:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db957 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.555594:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db957 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.555601:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db957 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.555928:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db95e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.555936:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db95e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.555943:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db95e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602544.555955:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787602544.556091:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db950 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.556098:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db950 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.556105:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db950 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.556111:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602544.556115:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db950 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.556124:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db950 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.556150:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:3.0:1787602544.556153:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602544.556159:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db950 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.556166:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db950 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.556181:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db957 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.556187:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db957 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.556192:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db957 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.556197:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602544.556200:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db957 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.556207:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db957 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.556214:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3529dc7800) 00010000:00010000:3.0:1787602544.556217:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602544.556220:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db957 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.556225:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db957 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.556282:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db949 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24e4 expref: 50 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.556298:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db95e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24e4 expref: 49 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.556305:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:3.0:1787602544.556307:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602544.556310:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433200, rc 0) 00000100:00100000:3.0:1787602544.556386:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+49:10532:x1874436833724800:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 990us (1175us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787602544.556394:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 102 00000100:00100000:0.0:1787602544.561415:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602544.561512:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833724928 00000100:00100000:2.0:1787602544.561523:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833724928 00000100:00100000:2.0:1787602544.561582:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 103 00000100:00100000:2.0:1787602544.561593:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+49:10532:x1874436833724928:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:2.0:1787602544.561677:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db96c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.561694:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db96c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.561706:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db96c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.561815:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db96c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.561823:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db96c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.561830:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db96c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.561836:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602544.561840:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db96c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.561847:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db96c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.561860:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:2.0:1787602544.561863:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787602544.561869:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db96c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.561875:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09db96c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602544.561949:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+49:10532:x1874436833724928:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 358us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602544.561957:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 103 00000100:00100000:0.0:1787602544.565308:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602544.565385:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833725184 00000100:00100000:2.0:1787602544.565396:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833725184 00000100:00100000:2.0:1787602544.565456:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00100000:2.0:1787602544.565481:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+49:10532:x1874436833725184:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:2.0:1787602544.565790:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+50:10532:x1874436833725184:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 310us (491us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787602544.565798:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00100000:1.0:1787602544.665704:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602544.665955:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833725440 00000100:00100000:3.0:1787602544.665965:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833725440 00000100:00100000:3.0:1787602544.666033:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 104 00000100:00100000:3.0:1787602544.666044:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+50:10542:x1874436833725440:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:3.0:1787602544.666071:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602544.666075:0:8208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787602544.666101:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09db8ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24c8 expref: 50 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.666131:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:3.0:1787602544.666136:0:8208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602544.666149:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db973 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c24eb expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.666273:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db97a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.666287:0:8208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db95e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24e4 expref: 50 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.666295:0:8208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db97a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.666327:0:8208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db95e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24e4 expref: 50 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.666340:0:8208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db95e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24e4 expref: 50 pid: 8208 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602544.666354:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d4b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853666048:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787602544.666455:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af52cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602544.669692:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d4b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853666048:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602544.669725:0:8208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db97a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602544.672554:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602544.673258:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833725568 00000100:00100000:0.0:1787602544.673270:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833725568 00010000:00010000:0.0:1787602544.673321:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db95e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24e4 expref: 51 pid: 8208 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602544.673413:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 52 00000100:00100000:0.0:1787602544.673425:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+51:2351:x1874436833725568:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602544.673442:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602544.673450:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db95e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24e4 expref: 51 pid: 8208 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.673482:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db95e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24e4 expref: 51 pid: 8208 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.673504:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09db95e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24e4 expref: 51 pid: 8208 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.673520:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:0.0:1787602544.673526:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db97a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.673537:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db97a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.673545:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db97a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.673587:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602544.673675:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+50:2351:x1874436833725568:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 252us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602544.673683:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 52 00010000:00010000:1.0:1787602544.673770:0:8208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db97a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.673780:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db97a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602544.673804:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787602544.673973:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09db973 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24eb expref: 51 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.674000:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db97a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24eb expref: 50 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.674021:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:1.0:1787602544.674024:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787602544.674027:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433e00, rc 0) 00000100:00100000:1.0:1787602544.674055:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+50:10542:x1874436833725440:12345-192.168.201.26@tcp:101:bash.0 Request processed in 8013us (8362us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1787602544.674062:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 104 00000100:00100000:0.0:1787602544.678115:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602544.678192:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833725824 00000100:00100000:2.0:1787602544.678203:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833725824 00000100:00100000:2.0:1787602544.678265:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 105 00000100:00100000:2.0:1787602544.678276:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+50:10542:x1874436833725824:12345-192.168.201.26@tcp:36:bash.0 00010000:00010000:2.0:1787602544.678589:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db988 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.678605:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db988 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.678614:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db988 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602544.678676:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787602544.678704:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000468b29 reply state 000000003d1b4394 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db988 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602544.678715:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787602544.678864:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+53:10542:x1874436833725824:12345-192.168.201.26@tcp:36:bash.0 Request processed in 589us (758us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787602544.678871:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 105 00000020:00080000:2.0:1787602544.678876:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787602544.682303:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db988 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.682322:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db988 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.682330:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db988 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.682352:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602544.682358:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db988 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.682366:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db988 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.682384:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:3.0:1787602544.682387:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602544.682392:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db988 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.682399:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09db988 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602544.683294:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602544.683388:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833725952 00000100:00100000:2.0:1787602544.683400:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833725952 00000100:00100000:2.0:1787602544.683459:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 106 00000100:00100000:2.0:1787602544.683480:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+52:10542:x1874436833725952:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787602544.683504:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602544.683523:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09db98f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c24f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.683617:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.683632:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db97a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24eb expref: 53 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.683640:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.683785:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db97a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24eb expref: 53 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.683800:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db97a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24eb expref: 53 pid: 8208 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602544.683886:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d489880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853666176:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602544.683975:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353976f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787602544.689474:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602544.689710:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d489880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853666176:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602544.689791:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602544.690367:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833726080 00000100:00100000:3.0:1787602544.690377:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833726080 00010000:00010000:3.0:1787602544.690423:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db97a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24eb expref: 54 pid: 8208 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602544.690514:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:3.0:1787602544.690526:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d48aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+54:2351:x1874436833726080:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602544.690541:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602544.690548:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db97a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24eb expref: 54 pid: 8208 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.690561:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db97a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24eb expref: 54 pid: 8208 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.690601:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db97a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24eb expref: 54 pid: 8208 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.690618:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:3.0:1787602544.690623:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.690633:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.690640:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.690684:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602544.690782:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d48aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+53:2351:x1874436833726080:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 257us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602544.690790:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 53 00010000:00010000:1.0:1787602544.691168:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.691176:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602544.691248:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787602544.691253:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602544.691278:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.691318:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09db98f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24f2 expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.691336:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24f2 expref: 52 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.691361:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:1.0:1787602544.691364:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602544.691367:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5800, rc 0) 00000100:00100000:1.0:1787602544.691413:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+52:10542:x1874436833725952:12345-192.168.201.26@tcp:101:bash.0 Request processed in 7934us (8126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602544.691420:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 106 00000100:00100000:2.0:1787602544.697088:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602544.697265:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833726336 00000100:00100000:1.0:1787602544.697280:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833726336 00000100:00100000:1.0:1787602544.697353:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 29 00000100:00100000:1.0:1787602544.697365:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+52:10542:x1874436833726336:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:1.0:1787602544.697626:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+53:10542:x1874436833726336:12345-192.168.201.26@tcp:35:bash.0 Request processed in 263us (550us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787602544.697635:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 29 00000100:00100000:3.0:1787602544.751183:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787602544.751211:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853666304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602544.751286:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602544.751404:0:10486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853666304 00000100:00100000:1.0:1787602544.751413:0:10486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853666304 00000100:00100000:1.0:1787602544.751473:0:10486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787602544.751484:0:10486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874436853666304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602544.751508:0:10486:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602544.751562:0:10486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874436853666304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602544.751568:0:10486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787602544.751670:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853666304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602544.779146:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602544.779241:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833726464 00000100:00100000:2.0:1787602544.779252:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833726464 00000100:00100000:2.0:1787602544.779321:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 107 00000100:00100000:2.0:1787602544.779331:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+53:10548:x1874436833726464:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787602544.779373:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602544.779397:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09db99d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c24f9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.779475:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09db9a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.779490:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09db9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.779501:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09db9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602544.779571:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787602544.779576:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602544.779601:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09db9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.779627:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09db99d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24f9 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.779648:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09db9a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24f9 expref: 54 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.779667:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:2.0:1787602544.779670:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787602544.779674:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5000, rc 0) 00000100:00100000:2.0:1787602544.779792:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+54:10548:x1874436833726464:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 412us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602544.779800:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 107 00000100:00100000:0.0:1787602544.785066:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602544.785156:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833726592 00000100:00100000:3.0:1787602544.785170:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833726592 00000100:00100000:3.0:1787602544.785244:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 108 00000100:00100000:3.0:1787602544.785256:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+54:10548:x1874436833726592:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602544.785289:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602544.785321:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db9ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2500 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785395:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db9b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785411:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db9b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785424:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db9b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785438:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db9b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785444:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785450:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785569:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db9c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785578:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db9c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785585:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db9c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602544.785624:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787602544.785628:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602544.785650:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db9c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785681:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db9c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785690:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db9b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785696:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db9b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785702:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db9b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785708:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602544.785712:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db9b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785720:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db9b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785733:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:3.0:1787602544.785736:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602544.785788:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db9b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785795:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09db9b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785808:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db9b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785814:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db9b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785827:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db9b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785832:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602544.785835:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db9b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785842:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db9b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785851:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3529dc7800) 00010000:00010000:3.0:1787602544.785854:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602544.785857:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db9b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785862:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09db9b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785896:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09db9ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2500 expref: 56 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785910:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db9c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2500 expref: 55 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602544.785917:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:3.0:1787602544.785919:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602544.785922:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433c00, rc 0) 00000100:00100000:3.0:1787602544.785979:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+55:10548:x1874436833726592:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 725us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602544.785995:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 108 00000100:00100000:3.0:1787602544.790949:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602544.791001:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602544.791088:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833726848 00000100:00100000:2.0:1787602544.791100:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833726848 00000100:00100000:2.0:1787602544.791173:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 109 00000100:00100000:2.0:1787602544.791186:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+55:10548:x1874436833726848:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787602544.791209:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602544.791243:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09db9c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2507 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.791393:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.791407:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24f2 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.791416:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db9c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2500 expref: 56 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.791423:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.791457:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db9c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2500 expref: 56 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.791470:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db9c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2500 expref: 56 pid: 8208 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602544.791482:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d489880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874436853666432:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602544.791605:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24f2 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.791621:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24f2 expref: 56 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602544.791630:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f03480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874436853666560:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602544.791656:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353976f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602544.791964:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833726976 00000100:00100000:0.0:1787602544.791971:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833726976 00010000:00010000:0.0:1787602544.791997:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db9c0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2500 expref: 57 pid: 8208 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602544.792046:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 54 00000100:00100000:0.0:1787602544.792056:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+57:2351:x1874436833726976:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602544.792066:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602544.792072:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db9c0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2500 expref: 57 pid: 8208 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.792084:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db9c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2500 expref: 57 pid: 8208 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.792103:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:0.0:1787602544.792109:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.792116:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.792122:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602544.792164:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+57:2351:x1874436833726976:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 110us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602544.792172:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 54 00000100:00100000:3.0:1787602544.799893:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602544.800401:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833727104 00000100:00100000:0.0:1787602544.800412:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833727104 00010000:00010000:0.0:1787602544.800458:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24f2 expref: 57 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602544.800496:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00100000:0.0:1787602544.800506:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3509d54850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+57:2351:x1874436833727104:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602544.800538:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602544.800545:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24f2 expref: 57 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.800559:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24f2 expref: 57 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.800580:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:0.0:1787602544.800585:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.800594:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.800601:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.800619:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602544.800973:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3509d54850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+57:2351:x1874436833727104:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 467us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602544.801046:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 55 00010000:00010000:2.0:1787602544.802734:0:5837:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.26@tcp) returned -22 from blocking AST (req@00000000327221c5 x1874436853666432) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db9c0 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2500 expref: 56 pid: 8208 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.802780:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09db9c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2500 expref: 56 pid: 8208 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602544.802799:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d489880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874436853666432:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602544.802817:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db996 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24f2 expref: 55 pid: 5836 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602544.802828:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f03480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874436853666560:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602544.802852:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:2.0:1787602544.802860:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.802869:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.802874:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602544.802916:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787602544.803109:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09db9c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2507 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.803125:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2507 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602544.803133:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:2.0:1787602544.803135:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787602544.803138:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5400, rc 0) 00000100:00100000:2.0:1787602544.803203:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+55:10548:x1874436833726848:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 12020us (12265us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787602544.803210:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 109 00000100:00100000:3.0:1787602544.807441:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602544.807546:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833727360 00000100:00100000:0.0:1787602544.807559:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833727360 00000100:00100000:0.0:1787602544.807640:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:0.0:1787602544.807651:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+55:10548:x1874436833727360:12345-192.168.201.26@tcp:103:lfs.0 00010000:00010000:0.0:1787602544.807676:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602544.807704:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09db92d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24dd expref: 55 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.807800:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:0.0:1787602544.807806:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602544.807862:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+54:10548:x1874436833727360:12345-192.168.201.26@tcp:103:lfs.0 Request processed in 213us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602544.807870:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:3.0:1787602544.810699:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602544.810916:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833727488 00000100:00100000:1.0:1787602544.810929:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833727488 00000100:00100000:1.0:1787602544.811007:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 110 00000100:00100000:1.0:1787602544.811018:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+54:10548:x1874436833727488:12345-192.168.201.26@tcp:58:lfs.0 00010000:00010000:1.0:1787602544.811154:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db9dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.811173:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db9dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602544.811185:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db9dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787602544.811464:0:8208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1787602544.811565:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+54:10548:x1874436833727488:12345-192.168.201.26@tcp:58:lfs.0 Request processed in 547us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602544.811573:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 110 00000100:00100000:1.0:1787602544.815295:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602544.815398:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833727616 00000100:00100000:0.0:1787602544.815410:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833727616 00000100:00100000:0.0:1787602544.815481:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 111 00000100:00100000:0.0:1787602544.815493:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+54:10548:x1874436833727616:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602544.815515:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602544.815536:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db9e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c250e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.815600:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db9dc lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.815612:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db9e3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c250e expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.815630:0:5838:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db9dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.815643:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db9e3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c250e expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.815667:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:0.0:1787602544.815687:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787602544.815691:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db9e3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c250e expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602544.815699:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e3000, rc 0) 00000100:00100000:0.0:1787602544.815811:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+55:10548:x1874436833727616:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 319us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602544.815819:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 111 00000100:00100000:3.0:1787602544.853842:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602544.853889:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602544.853922:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602544.854021:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833728000 00000100:00100000:2.0:1787602544.854030:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833728000 00000100:00100000:2.0:1787602544.854095:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 142 00000100:00100000:2.0:1787602544.854104:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2354:x1874436833728000:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602544.854173:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2354:x1874436833728000:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 71us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602544.854180:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 142 00000100:00100000:1.0:1787602544.854517:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833727744 00000100:00100000:1.0:1787602544.854521:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833727744 00000100:00100000:1.0:1787602544.854556:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 290 00000100:00100000:1.0:1787602544.854562:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833727744:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602544.854589:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833727744:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 27us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602544.854595:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 290 00000100:00080000:3.0:1787602544.854817:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602544.854880:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833727872 00000100:00100000:0.0:1787602544.854885:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833727872 00000100:00100000:0.0:1787602544.854925:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 80 00000100:00100000:0.0:1787602544.854933:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2354:x1874436833727872:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602544.854979:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2354:x1874436833727872:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 47us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602544.854985:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 80 00010000:00010000:0.0:1787602545.326181:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787602545.453018:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602545.453028:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602545.453101:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787602545.453108:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787602545.453248:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874436853666688:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787602545.453359:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350c8b93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602545.459877:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602545.460005:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833728128 00000100:00100000:0.0:1787602545.460015:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833728128 00000100:00100000:0.0:1787602545.460107:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 112 00000100:00100000:0.0:1787602545.460121:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+56:10549:x1874436833728128:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787602545.460154:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787602545.460267:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+56:10549:x1874436833728128:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 150us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602545.460275:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 112 00000100:00080000:3.0:1787602545.460528:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602545.473822:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874436853666688:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787602545.478641:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602545.478794:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833728256 00000100:00100000:2.0:1787602545.478805:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833728256 00000100:00100000:2.0:1787602545.478860:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 113 00000100:00100000:2.0:1787602545.478870:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+55:10549:x1874436833728256:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787602545.478962:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db9ea lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480516:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db9ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480540:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db9ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480568:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db9f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480576:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480583:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480615:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db9f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480625:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480632:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602545.480698:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787602545.480704:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602545.480718:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480730:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db9ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480776:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db9ea lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480782:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db9ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480789:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602545.480794:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db9ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480801:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db9ea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480815:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d350b502400) 00010000:00010000:2.0:1787602545.480819:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602545.480824:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db9ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480830:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09db9ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480847:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480852:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db9f1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480859:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480864:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602545.480874:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480881:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db9f1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480889:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8d3504d95400) 00010000:00010000:2.0:1787602545.480892:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602545.480895:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db9f1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480900:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09db9f1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480915:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480920:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db9f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480924:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db9f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480928:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602545.480931:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db9f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480936:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db9f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480942:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:2.0:1787602545.480944:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602545.480954:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db9f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.480959:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09db9f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602545.481348:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+55:10549:x1874436833728256:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 Request processed in 2474us (2711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602545.481359:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 113 00000100:00100000:0.0:1787602545.493849:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602545.494007:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833728512 00000100:00100000:1.0:1787602545.494018:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833728512 00000100:00100000:1.0:1787602545.494095:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 114 00000100:00100000:1.0:1787602545.494108:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+55:10549:x1874436833728512:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602545.494130:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602545.494154:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db9ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2515 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.494269:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dba06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.494289:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dba06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.494302:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dba06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602545.494314:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787602545.494428:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dba06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.494437:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dba06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.494444:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dba06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.494451:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eb200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602545.494456:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dba06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.494463:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dba06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.494490:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:1.0:1787602545.494493:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787602545.494498:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dba06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.494505:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dba06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.494550:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db9ff lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2515 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.494559:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d350b502400) 00010000:00010000:1.0:1787602545.494562:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602545.494566:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09db9ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2515 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.494575:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354ea800, rc 0) 00000100:00100000:1.0:1787602545.494656:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+56:10549:x1874436833728512:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 541us (808us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1787602545.494664:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 114 00000100:00100000:3.0:1787602545.507865:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602545.508550:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833728640 00000100:00100000:0.0:1787602545.508573:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833728640 00000100:00100000:0.0:1787602545.508663:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 115 00000100:00100000:0.0:1787602545.508676:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+56:10549:x1874436833728640:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787602545.508955:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787602545.510178:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+56:10549:x1874436833728640:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 1498us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602545.510190:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 115 00000100:00100000:3.0:1787602545.535850:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602545.536255:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833728896 00000100:00100000:1.0:1787602545.536266:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833728896 00000100:00100000:1.0:1787602545.536331:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 116 00000100:00100000:1.0:1787602545.536341:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+56:10549:x1874436833728896:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602545.536362:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602545.536365:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787602545.536392:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09db9a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c24f9 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.536434:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:1.0:1787602545.536439:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602545.536454:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09dba14 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c251c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787602545.537530:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1787602545.537808:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dba1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.537824:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dba1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.537836:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dba1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.539582:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09dba14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c251c expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.539612:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dba1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c251c expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.539622:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:1.0:1787602545.539625:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602545.539629:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eb200, rc 0) 00000100:00100000:1.0:1787602545.540415:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+57:10549:x1874436833728896:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 4069us (4569us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787602545.540424:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 116 00000100:00100000:2.0:1787602545.550155:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602545.550254:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833729152 00000100:00100000:0.0:1787602545.550264:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833729152 00000100:00100000:0.0:1787602545.550325:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 117 00000100:00100000:0.0:1787602545.550336:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+57:10549:x1874436833729152:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787602545.550397:0:8208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602545.550423:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dba1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c251c expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550442:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:0.0:1787602545.550452:0:8208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602545.550473:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba29 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550487:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550496:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550509:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dba30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf788fa02 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550532:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dba30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf788fa02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550538:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dba30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf788fa02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550614:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550620:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba29 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550626:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba29 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550632:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e2600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602545.550635:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba29 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550661:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba29 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550669:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:0.0:1787602545.550671:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602545.550675:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba29 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550680:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba29 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550690:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dba30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf788fa02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550701:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dba30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf788fa02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550706:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dba30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf788fa02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550710:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e2e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602545.550713:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dba30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf788fa02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550728:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dba30 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf788fa02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550735:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf788fa02 (ffff8d350b502000) 00010000:00010000:0.0:1787602545.550737:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602545.550783:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dba30 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf788fa02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.550789:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dba30 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf788fa02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602545.550873:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+56:10549:x1874436833729152:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 539us (728us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787602545.550880:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 117 00000100:00100000:3.0:1787602545.557595:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602545.557779:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833729280 00000100:00100000:2.0:1787602545.557791:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833729280 00000100:00100000:2.0:1787602545.557843:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 118 00000100:00100000:2.0:1787602545.557854:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+56:10549:x1874436833729280:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602545.557874:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602545.557899:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dba37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2523 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.557936:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dba3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.557949:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dba3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.557960:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dba3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.558302:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dba37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2523 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.558335:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dba3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2523 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.558344:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3504d95400) 00010000:00010000:2.0:1787602545.558346:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787602545.558350:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5800, rc 0) 00000100:00100000:2.0:1787602545.558518:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+57:10549:x1874436833729280:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 665us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602545.558525:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 118 00000100:00100000:3.0:1787602545.573121:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602545.573212:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833729536 00000100:00100000:0.0:1787602545.573223:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833729536 00000100:00100000:0.0:1787602545.573284:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 119 00000100:00100000:0.0:1787602545.573294:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+57:10549:x1874436833729536:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787602545.573379:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.573412:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.573426:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787602545.573703:0:8208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1787602545.573714:0:8208:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 330519969828ns, next at 331519966394ns, rc = 0 00000004:00010000:1.0:1787602545.578148:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c725aff6 reply state 00000000ae50982c transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602545.578169:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787602545.578347:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+59:10549:x1874436833729536:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 5050us (5231us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787602545.578355:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 119 00000100:00100000:3.0:1787602545.587233:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00010000:00010000:1.0:1787602545.587307:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.587320:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.587328:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.587334:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e2600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602545.587339:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.587347:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.587365:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3504d95400) 00010000:00010000:1.0:1787602545.587368:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787602545.587374:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.587380:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dba45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602545.587443:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833729664 00000100:00100000:2.0:1787602545.587454:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833729664 00000100:00100000:2.0:1787602545.587512:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 120 00000100:00100000:2.0:1787602545.587523:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+58:10549:x1874436833729664:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602545.588141:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602545.588167:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dba4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c252a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.588234:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dba4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c252a expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.588248:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dba4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c252a expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.588267:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3504d95400) 00010000:00010000:2.0:1787602545.588270:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602545.588287:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4c00, rc 0) 00000100:00100000:2.0:1787602545.589024:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+59:10549:x1874436833729664:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 1498us (1798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602545.589033:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 120 00000100:00100000:3.0:1787602545.592189:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602545.592690:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833729792 00000100:00100000:2.0:1787602545.592700:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833729792 00000100:00100000:2.0:1787602545.595357:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 37 00000100:00100000:2.0:1787602545.595372:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2351:x1874436833729792:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787602545.595707:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+9:2351:x1874436833729792:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 338us (3526us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787602545.595726:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 37 00000100:00080000:3.0:1787602545.595805:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787602545.598856:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602545.599071:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833730048 00000100:00100000:0.0:1787602545.599081:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833730048 00000100:00100000:0.0:1787602545.599139:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 30 00000100:00100000:0.0:1787602545.599149:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+59:10549:x1874436833730048:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787602545.599384:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+60:10549:x1874436833730048:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 236us (537us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787602545.599392:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 30 00000100:00100000:3.0:1787602545.603984:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602545.604154:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833730304 00000100:00100000:0.0:1787602545.604164:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833730304 00000100:00100000:0.0:1787602545.604235:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 121 00000100:00100000:0.0:1787602545.604247:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+60:10549:x1874436833730304:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787602545.604357:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+60:10549:x1874436833730304:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 113us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602545.604364:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 121 00000100:00100000:3.0:1787602545.607080:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602545.607343:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833730432 00000100:00100000:0.0:1787602545.607353:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833730432 00000100:00100000:0.0:1787602545.607409:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 122 00000100:00100000:0.0:1787602545.607418:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+60:10549:x1874436833730432:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602545.607450:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602545.607470:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dba53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2531 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.607533:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09dba5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.607546:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09dba5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.607557:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09dba5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602545.607595:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602545.607613:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09dba5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.607639:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dba53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2531 expref: 62 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.607669:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09dba5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2531 expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.607679:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3504d95400) 00010000:00010000:0.0:1787602545.607682:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787602545.607685:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2800, rc 0) 00000100:00100000:0.0:1787602545.607738:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+61:10549:x1874436833730432:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 320us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602545.607788:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 122 00000100:00100000:3.0:1787602545.612505:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602545.612601:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833730560 00000100:00100000:0.0:1787602545.612611:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833730560 00000100:00100000:0.0:1787602545.612679:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 38 00000100:00100000:0.0:1787602545.612691:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+9:2352:x1874436833730560:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602545.612710:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602545.612804:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d5eccc7/0x3640686da09dba61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2538 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787602545.612834:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8ca672, blocks: 0x1 00010000:00010000:0.0:1787602545.612854:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=330s v=(0 0) 00010000:00010000:0.0:1787602545.612859:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602545.612870:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d5eccc7/0x3640686da09dba61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2538 expref: 10 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.612888:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d5eccc7/0x3640686da09dba61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2538 expref: 10 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.612902:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e3a00, rc 0) 00000100:00100000:0.0:1787602545.612960:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+10:2352:x1874436833730560:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 273us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602545.612968:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 38 00000100:00100000:3.0:1787602545.617354:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602545.617522:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833730816 00000100:00100000:0.0:1787602545.617533:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833730816 00000100:00100000:0.0:1787602545.617610:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 123 00000100:00100000:0.0:1787602545.617622:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+61:10549:x1874436833730816:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787602545.618037:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+61:10549:x1874436833730816:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 416us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602545.618059:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 123 00000100:00100000:1.0:1787602545.621397:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602545.621505:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833730944 00000100:00100000:2.0:1787602545.621515:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833730944 00000100:00100000:2.0:1787602545.621573:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:2.0:1787602545.621584:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+10:10549:x1874436833730944:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602545.621603:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602545.621622:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dba68 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c253f expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.621665:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d5eccc7/0x3640686da09dba61 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2538 expref: 11 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.621674:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602545.621678:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602545.621683:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dba68 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c253f expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.621776:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d5eccc7/0x3640686da09dba61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2538 expref: 11 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.621791:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d5eccc7/0x3640686da09dba61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2538 expref: 11 pid: 6689 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602545.621806:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1874436853666816:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602545.621897:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353976f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602545.627170:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602545.627441:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833731072 00000100:00100000:0.0:1787602545.627451:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833731072 00010000:00010000:0.0:1787602545.627495:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d5eccc7/0x3640686da09dba61 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2538 expref: 12 pid: 6689 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602545.627536:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 56 00000100:00100000:0.0:1787602545.627548:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d265880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+12:2352:x1874436833731072:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602545.627564:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602545.627587:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d5eccc7/0x3640686da09dba61 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2538 expref: 12 pid: 6689 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.627601:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d5eccc7/0x3640686da09dba61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2538 expref: 12 pid: 6689 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.627623:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602545.627628:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602545.627636:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dba68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c253f expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.627657:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dba68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c253f expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.627695:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dba68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c253f expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602545.627737:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d5ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1874436853666944:192.168.201.26@tcp:105: 00000100:00100000:0.0:1787602545.627852:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af326c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787602545.628575:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d5eccc7/0x3640686da09dba61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2538 expref: 12 pid: 6689 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602545.628591:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1874436853666816:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602545.628614:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dba68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c253f expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.628625:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4e00, rc 0) 00000100:00100000:2.0:1787602545.628677:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+11:10549:x1874436833730944:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 7094us (7288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602545.629283:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:3.0:1787602545.634056:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602545.634141:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833731200 00000100:00100000:2.0:1787602545.634150:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833731200 00002000:00100000:2.0:1787602545.634201:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d353d266300 x1874436833731200/t0(0) o4->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:381/0 lens 504/0 e 0 to 0 dl 1787602556 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787602545.634231:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d353d266300 with x1874436833731200 ext(0->12) 00002000:00010000:2.0:1787602545.634237:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d353d266300 00000100:00100000:2.0:1787602545.634274:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:2.0:1787602545.634284:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+11:2351:x1874436833731200:12345-192.168.201.26@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787602545.634797:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+13:2351:x1874436833731200:12345-192.168.201.26@tcp:4:lhsmtool_posix.0 Request processed in 514us (749us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787602545.634805:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 2 00002000:00100000:2.0:1787602545.634811:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d353d266300 x1874436833731200/t4294967308(0) o4->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:381/0 lens 504/448 e 0 to 0 dl 1787602556 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787602545.634819:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d353d266300 with x1874436833731200 ext(0->12) 00002000:00010000:2.0:1787602545.634822:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d353d266300 00000100:00100000:0.0:1787602545.634974:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d5ad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1874436853666944:192.168.201.26@tcp:105: 00010000:00010000:0.0:1787602545.634997:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602545.635020:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d265880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+12:2352:x1874436833731072:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 7476us (7862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602545.635029:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 56 00000100:00100000:3.0:1787602545.637116:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602545.637400:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833731328 00000100:00100000:1.0:1787602545.637408:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833731328 00000100:00100000:1.0:1787602545.637456:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 124 00000100:00100000:1.0:1787602545.637464:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+61:10549:x1874436833731328:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787602545.691262:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1787602545.691281:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1787602545.691301:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:0.0:1787602545.691363:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787602545.691381:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d3507ce3cc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787602545.691388:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d350927ae00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d3507ce3000 00000020:00080000:0.0:1787602545.691391:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d350927aa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d353cb6c000 00000020:00080000:0.0:1787602545.691424:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d353d5946c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787602545.691428:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d350927a600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d353d594cc0 00000020:00080000:0.0:1787602545.691430:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d350927a300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d3535674c00 00000020:00080000:0.0:1787602545.691440:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1787602545.691571:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787602545.691961:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787602545.692055:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853667072:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787602545.692124:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602545.692183:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853667072 00000100:00100000:0.0:1787602545.692202:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853667072 00000100:00100000:0.0:1787602545.692250:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787602545.692259:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1874436853667072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787602545.692287:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1787602545.692320:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8ca671, atime: 0x6a8ca671, ctime: 0x6a8ca671, blocks: 0x1 00010000:00010000:0.0:1787602545.692328:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006af55d12/0x3640686da09dba6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.692341:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=330s v=(0 0) 00010000:00010000:0.0:1787602545.692344:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602545.692349:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006af55d12/0x3640686da09dba6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.692361:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006af55d12/0x3640686da09dba6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.692368:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006af55d12/0x3640686da09dba6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.692373:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006af55d12/0x3640686da09dba6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.692385:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787602545.693241:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3301:x1874436853667072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 980us (1113us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787602545.693250:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1787602545.693280:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602545.693295:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006af55d12/0x3640686da09dba6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.693304:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e2e00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602545.693308:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006af55d12/0x3640686da09dba6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.693317:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006af55d12/0x3640686da09dba6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.693335:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006af55d12/0x3640686da09dba6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.693343:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006af55d12/0x3640686da09dba6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.693364:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602545.693366:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602545.693367:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787602545.693400:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d353d5ad500/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787602545.693407:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853667072:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787602545.693587:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853667328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787602545.693624:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602545.693843:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853667200:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787602545.693868:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602545.693901:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853667328 00000100:00100000:1.0:1787602545.693907:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853667328 00000100:00100000:1.0:1787602545.693934:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853667200 00000100:00100000:1.0:1787602545.693937:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853667200 00000100:00100000:1.0:1787602545.693955:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787602545.693964:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1874436853667328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787602545.694114:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787602545.694118:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787602546 00002000:00010000:1.0:1787602545.694120:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787602545.694122:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787602546 -> 1787602546 00002000:00010000:1.0:1787602545.694124:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787602545.694156:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3303:x1874436853667328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (532us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787602545.694161:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1787602545.694181:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d353557ed80/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787602545.694185:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853667328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787602545.694194:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787602545.694199:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1874436853667200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787602545.694217:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1787602545.694232:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009454a578/0x3640686da09dba76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.694250:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf834878/0x3640686da09db831 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c249e expref: 11 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.694258:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787602545.694262:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787602545.694266:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009454a578/0x3640686da09dba76 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.694293:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf834878/0x3640686da09db831 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c249e expref: 11 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.694304:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf834878/0x3640686da09db831 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c249e expref: 11 pid: 8625 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602545.694313:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1874436853667456:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602545.694446:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353ca93780 going to sleep for 11 seconds 00000100:00100000:2.0:1787602545.696541:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+15:10549:x1874436833731328:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 Request processed in 59070us (59425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602545.696549:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 124 00000100:00100000:0.0:1787602545.700288:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602545.700790:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833731456 00000100:00100000:3.0:1787602545.700801:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833731456 00010000:00010000:3.0:1787602545.700843:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf834878/0x3640686da09db831 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c249e expref: 12 pid: 8625 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602545.700887:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:3.0:1787602545.700898:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+12:2351:x1874436833731456:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602545.700912:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602545.700919:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf834878/0x3640686da09db831 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c249e expref: 12 pid: 8625 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.700934:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf834878/0x3640686da09db831 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c249e expref: 12 pid: 8625 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.700959:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787602545.700965:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787602545.700983:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009454a578/0x3640686da09dba76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.700994:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009454a578/0x3640686da09dba76 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.701014:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602545.701072:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+12:2351:x1874436833731456:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 175us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602545.701080:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 57 00010000:00010000:1.0:1787602545.702034:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf834878/0x3640686da09db831 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c249e expref: 11 pid: 8625 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602545.702056:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1874436853667456:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602545.702079:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009454a578/0x3640686da09dba76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.702101:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009454a578/0x3640686da09dba76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.702106:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009454a578/0x3640686da09dba76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.702114:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009454a578/0x3640686da09dba76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.702118:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009454a578/0x3640686da09dba76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.702134:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787602545.702727:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602545.702734:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009454a578/0x3640686da09dba76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.702763:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea400 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602545.702776:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009454a578/0x3640686da09dba76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.702787:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009454a578/0x3640686da09dba76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.702803:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009454a578/0x3640686da09dba76 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.702808:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009454a578/0x3640686da09dba76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.702822:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602545.702824:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602545.702825:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602545.702880:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3302:x1874436853667200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8679us (9008us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787602545.702888:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1787602545.705814:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d353557d180/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787602545.705831:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853667200:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787602545.707550:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602545.708410:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833731584 00000100:00100000:2.0:1787602545.708423:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833731584 00000100:00100000:2.0:1787602545.708491:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:2.0:1787602545.708502:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+11:2351:x1874436833731584:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787602545.747161:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1787602545.747190:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1787602545.747321:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2351:x1874436833731584:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 Request processed in 38816us (39774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602545.747349:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:1.0:1787602545.750211:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602545.750507:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833731840 00000100:00100000:2.0:1787602545.750518:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833731840 00000100:00100000:2.0:1787602545.750586:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 125 00000100:00100000:2.0:1787602545.750597:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+15:10549:x1874436833731840:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787602545.750664:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602545.750692:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2800/0x3640686da09dba5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2531 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.750871:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3504d95400) 00010000:00010000:2.0:1787602545.750877:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787602545.750911:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dba7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.750926:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dba7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.750936:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dba7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602545.751197:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb8df818 reply state 000000002ac16b9b transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dba7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602545.751207:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787602545.751558:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+16:10549:x1874436833731840:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 960us (1354us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787602545.751566:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 125 00000100:00100000:3.0:1787602545.754776:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602545.754893:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833731968 00000100:00100000:1.0:1787602545.754904:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833731968 00000100:00100000:1.0:1787602545.754958:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:1.0:1787602545.754981:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2351:x1874436833731968:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787602545.755251:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787602545.755255:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787602546 -> 1787602545 00002000:00010000:1.0:1787602545.755258:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787602545 00002000:00010000:1.0:1787602545.755260:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787602546 -> 1787602545 00002000:00010000:1.0:1787602545.755269:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1787602545.755364:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dba7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.755376:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dba7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.755383:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dba7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.755388:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602545.755392:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dba7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.755397:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dba7d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.755417:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3504d95400) 00010000:00010000:0.0:1787602545.755419:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602545.755422:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dba7d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.755426:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dba7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602545.756498:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833731968:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 1522us (1749us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787602545.756508:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:3.0:1787602545.759238:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602545.759402:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833732224 00000100:00100000:2.0:1787602545.759426:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833732224 00000100:00100000:2.0:1787602545.759526:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 126 00000100:00100000:2.0:1787602545.759538:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+15:10549:x1874436833732224:12345-192.168.201.26@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787602545.759612:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dba84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.759629:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dba3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2523 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.759648:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dba84 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.759684:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dba3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2523 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.759697:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dba3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2523 expref: 15 pid: 5837 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602545.761847:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f00700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874436853667584:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787602545.762269:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503569d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787602545.765625:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602545.766158:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833732352 00000100:00100000:0.0:1787602545.766168:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833732352 00010000:00010000:0.0:1787602545.766212:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dba3e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2523 expref: 16 pid: 5837 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602545.766265:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 58 00000100:00100000:0.0:1787602545.766276:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+16:2351:x1874436833732352:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602545.766292:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602545.766299:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dba3e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2523 expref: 16 pid: 5837 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.766311:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dba3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2523 expref: 16 pid: 5837 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.766334:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3504d95400) 00010000:00010000:0.0:1787602545.766339:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dba84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.766348:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dba84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.766373:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dba84 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.766393:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602545.766457:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+16:2351:x1874436833732352:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 183us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602545.766465:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 58 00010000:00010000:3.0:1787602545.768876:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dba3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2523 expref: 15 pid: 5837 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602545.768904:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f00700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874436853667584:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602545.768931:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dba84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.768941:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dba84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.768947:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dba84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.769088:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dba84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.769096:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dba84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.769104:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dba84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.769110:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602545.769114:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dba84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.769121:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dba84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.769135:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3504d95400) 00010000:00010000:3.0:1787602545.769154:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787602545.769160:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dba84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.769166:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dba84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602545.769530:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+14:10549:x1874436833732224:12345-192.168.201.26@tcp:55:lhsmtool_posix.0 Request processed in 9992us (10298us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787602545.769540:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 126 00000100:00100000:2.0:1787602545.773245:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602545.773619:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833732480 00000100:00100000:0.0:1787602545.773630:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833732480 00000100:00100000:0.0:1787602545.773951:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:0.0:1787602545.773963:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2352:x1874436833732480:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787602545.774019:0:8625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dba8b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.774041:0:8625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dba68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c253f expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.774049:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602545.774053:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602545.774057:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dba8b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.774097:0:8625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dba68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c253f expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.774111:0:8625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dba68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c253f expref: 7 pid: 6690 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602545.774141:0:8625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d5ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1874436853667712:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787602545.774279:0:8625:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32840 going to sleep for 11 seconds 00000100:00100000:0.0:1787602545.777779:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602545.777882:0:8625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d5ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1874436853667712:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602545.777913:0:8625:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dba8b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602545.778001:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833732608 00000100:00100000:3.0:1787602545.778009:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833732608 00010000:00010000:3.0:1787602545.778045:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dba68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c253f expref: 8 pid: 6690 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602545.778083:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:3.0:1787602545.778092:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2351:x1874436833732608:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602545.778106:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602545.778130:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dba68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c253f expref: 8 pid: 6690 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.778143:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dba68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c253f expref: 8 pid: 6690 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.778165:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dba68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c253f expref: 8 pid: 6690 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.778181:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787602545.778197:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787602545.778203:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dba8b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.778211:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dba8b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.778246:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602545.778299:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833732608:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 207us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602545.778306:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 59 00010000:00010000:0.0:1787602545.778947:0:8625:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dba8b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.778959:0:8625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dba8b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.778996:0:8625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dba8b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.779004:0:8625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dba8b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.779012:0:8625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dba8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.779019:0:8625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e2a00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602545.779023:0:8625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dba8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.779033:0:8625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dba8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.779061:0:8625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dba8b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.779068:0:8625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dba8b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602545.779141:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833732480:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 Request processed in 5179us (5906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602545.779149:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:0.0:1787602545.784303:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602545.784410:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833732864 00000100:00100000:3.0:1787602545.784419:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833732864 00000100:00100000:3.0:1787602545.784476:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 127 00000100:00100000:3.0:1787602545.784487:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+14:10549:x1874436833732864:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787602545.784569:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dba92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.784587:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dba92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.784598:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dba92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.784924:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dba99 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.784936:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dba4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c252a expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.784956:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dba99 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.785165:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dba4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c252a expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.785180:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dba4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c252a expref: 15 pid: 5838 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602545.785194:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853667840:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787602545.785332:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35351f1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787602545.789168:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602545.789310:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853667840:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602545.789342:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dba99 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602545.789883:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833732992 00000100:00100000:0.0:1787602545.789892:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833732992 00010000:00010000:0.0:1787602545.789941:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dba4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c252a expref: 16 pid: 5838 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602545.789988:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:0.0:1787602545.789999:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+16:2352:x1874436833732992:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602545.790015:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602545.790022:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dba4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c252a expref: 16 pid: 5838 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.790035:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dba4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c252a expref: 16 pid: 5838 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.790058:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dba4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c252a expref: 16 pid: 5838 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.790090:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3504d95400) 00010000:00010000:0.0:1787602545.790095:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dba99 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.790104:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dba99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.790112:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dba99 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.790142:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602545.790200:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+15:2352:x1874436833732992:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 203us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602545.790208:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 60 00010000:00010000:3.0:1787602545.790293:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dba99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.790301:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dba99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787602545.790498:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1787602545.790657:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1787602545.790704:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1787602545.790846:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874436853667968:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787602545.790901:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602545.790931:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35351f1780 going to sleep for 11 seconds 00000100:00100000:0.0:1787602545.791226:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853667968 00000100:00100000:0.0:1787602545.791233:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853667968 00000100:00100000:0.0:1787602545.791279:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787602545.791288:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1874436853667968:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787602545.791363:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1874436853667968:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602545.791370:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787602545.791402:0:5836:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787602545.791407:0:5836:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1787602545.791424:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d353557ed80, transno 4294967309 00000004:00080000:0.0:1787602545.791435:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d353557d180, transno 4294967310 00000100:00100000:0.0:1787602545.791440:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874436853667968:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787602545.792205:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787602545.792526:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d5ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874436853668096:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787602545.792568:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602545.792869:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602545.794611:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853668096 00000100:00100000:2.0:1787602545.794624:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853668096 00000100:00100000:2.0:1787602545.794814:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787602545.794824:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1874436853668096:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787602545.795210:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1874436853668096:12345-0@lo:1000:mdt00_000.0 Request processed in 387us (2639us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787602545.795326:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d5ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874436853668096:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787602545.795369:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dba99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.795380:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dba99 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.795388:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dba99 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.795395:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602545.795399:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dba99 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.795407:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dba99 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.795423:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3504d95400) 00010000:00010000:0.0:1787602545.795427:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787602545.795432:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dba99 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.795438:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dba99 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.795470:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db9dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.795477:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db9dc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.795494:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db9dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.795499:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ebe00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602545.795502:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db9dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.795507:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db9dc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.795515:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:0.0:1787602545.795518:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787602545.795525:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db9e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c250e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.795536:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db9e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c250e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.795544:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db9e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c250e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.795577:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db9e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c250e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602545.795592:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d5ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853668224:192.168.201.26@tcp:105: 00000100:00100000:0.0:1787602545.795684:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602545.797147:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787602545.799431:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d5ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853668224:192.168.201.26@tcp:105: 00010000:00010000:0.0:1787602545.799477:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db9dc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799488:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09db9dc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799519:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09dbaa0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799533:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09dbaa0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799543:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09dbaa0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799554:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09dbaa0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799559:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09dbaa0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799565:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09dbaa0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799570:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e2a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602545.799574:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09dbaa0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799580:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09dbaa0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799592:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:0.0:1787602545.799595:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602545.799606:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09dbaa0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799612:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09dbaa0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799625:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dba92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799630:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dba92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799635:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dba92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799668:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602545.799673:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dba92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799679:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dba92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799687:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:0.0:1787602545.799689:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787602545.799691:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dba92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602545.799696:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dba92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602545.799961:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+18:10549:x1874436833732864:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 15474us (15668us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787602545.799981:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 127 00000020:00080000:0.0:1787602545.799994:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787602545.800266:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602545.800272:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602545.800823:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787602545.800833:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787602545.802467:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602545.802538:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833733120 00000100:00100000:0.0:1787602545.802547:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833733120 00000100:00100000:0.0:1787602545.802606:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00100000:0.0:1787602545.802617:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+18:10548:x1874436833733120:12345-192.168.201.26@tcp:49:lfs.0 00000100:00100000:0.0:1787602545.803005:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+18:10548:x1874436833733120:12345-192.168.201.26@tcp:49:lfs.0 Request processed in 388us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602545.803013:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00100000:1.0:1787602545.805917:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602545.808605:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602545.808689:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833733632 00000100:00100000:3.0:1787602545.808699:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833733632 00000100:00100000:3.0:1787602545.808901:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 128 00000100:00100000:3.0:1787602545.808912:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+18:10548:x1874436833733632:12345-192.168.201.26@tcp:58:lfs.0 00000040:00080000:3.0:1787602545.809502:0:8208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787602545.809590:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+18:10548:x1874436833733632:12345-192.168.201.26@tcp:58:lfs.0 Request processed in 679us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602545.809599:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 128 00000100:00100000:2.0:1787602545.811067:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833733376 00000100:00100000:2.0:1787602545.811082:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833733376 00000100:00100000:2.0:1787602545.811190:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00100000:2.0:1787602545.811199:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3527f61050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+18:10549:x1874436833733376:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787602545.811909:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787602545.815192:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1787602545.815301:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbaa7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.815320:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbaa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.815332:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbaa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.815341:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbaa7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.815348:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbaa7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.815354:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbaa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.815387:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787602545.815522:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3527f61050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+20:10549:x1874436833733376:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 4320us (9611us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787602545.815532:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 32 00000020:00080000:2.0:1787602545.815538:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787602545.816250:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602545.816261:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbaa7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.816271:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4a00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:3.0:1787602545.816276:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbaa7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.816285:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbaa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.816302:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d3504d95c00) 00010000:00010000:3.0:1787602545.816305:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787602545.816309:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbaa7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.816314:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbaa7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.816333:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602545.816335:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602545.816337:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602545.849866:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602545.849978:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833733760 00000100:00100000:2.0:1787602545.849990:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833733760 00000100:00100000:2.0:1787602545.850070:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 129 00000100:00100000:2.0:1787602545.850082:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+20:10551:x1874436833733760:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787602545.850107:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602545.850130:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbaae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2546 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.850196:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbab5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.850211:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbab5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.850221:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbab5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.850236:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbabc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.850243:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbabc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.850248:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbabc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.850545:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dbac3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.850563:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2507 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.850572:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dbac3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.850609:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2507 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602545.850624:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2507 expref: 21 pid: 5837 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602545.850649:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f03b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874436853668352:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602545.850788:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503569d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787602545.857299:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602545.857392:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833734016 00000100:00100000:0.0:1787602545.857402:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833734016 00000100:00100000:0.0:1787602545.857462:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:0.0:1787602545.857473:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+22:5590:x1874436833734016:12345-192.168.201.26@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787602545.857734:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+23:5590:x1874436833734016:12345-192.168.201.26@tcp:35:ldlm_bl.0 Request processed in 262us (444us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1787602545.857780:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:2.0:1787602545.858968:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f03b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874436853668352:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602545.858998:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dbac3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602545.863937:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602545.864082:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833734144 00000100:00100000:3.0:1787602545.864106:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833734144 00010000:00010000:3.0:1787602545.864150:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2507 expref: 23 pid: 5837 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602545.864198:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:3.0:1787602545.864210:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3509d56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+23:2352:x1874436833734144:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602545.864225:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602545.864233:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2507 expref: 23 pid: 5837 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.864249:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2507 expref: 23 pid: 5837 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.864275:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09db9ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2507 expref: 23 pid: 5837 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.864298:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:3.0:1787602545.864304:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dbac3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.864314:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dbac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.864322:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dbac3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602545.864360:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602545.864431:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3509d56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+22:2352:x1874436833734144:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 222us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602545.864448:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 61 00010000:00010000:1.0:1787602545.864620:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dbac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864629:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dbac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602545.864682:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787602545.864687:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602545.864706:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dbac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864728:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dbac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864737:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbab5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864794:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbab5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864800:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbab5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864806:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602545.864811:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbab5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864819:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbab5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864830:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:1.0:1787602545.864833:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602545.864836:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbab5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864842:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbab5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864852:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbabc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864858:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbabc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864863:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbabc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864868:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602545.864879:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbabc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864886:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbabc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864895:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d3504d95700) 00010000:00010000:1.0:1787602545.864897:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602545.864900:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbabc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864906:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbabc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864941:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbaae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2546 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864954:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dbac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2546 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602545.864962:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:1.0:1787602545.865127:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602545.865131:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5c00, rc 0) 00000100:00100000:1.0:1787602545.865165:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+21:10551:x1874436833733760:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 15085us (15312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602545.865172:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 129 00010000:00010000:0.0:1787602546.362191:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787602546.769968:0:12101:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787602546.769978:0:12101:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787602546.770043:0:12101:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787602546.770050:0:12101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787602546.814369:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787602546.814391:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853668480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602546.815047:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602546.815142:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853668480 00000100:00100000:3.0:1787602546.815152:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853668480 00000100:00100000:3.0:1787602546.821317:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787602546.821332:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874436853668480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602546.821375:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787602546.821484:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874436853668480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (6437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602546.821491:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787602546.821709:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853668480:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787602546.821815:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787602546.861039:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602546.861048:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602546.861094:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787602546.861119:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787602546.861233:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874436853668608:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787602546.861365:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353ca93480 going to sleep for 11 seconds 00000100:00100000:3.0:1787602546.895212:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874436853668608:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787602546.911202:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602546.911775:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833734272 00000100:00100000:3.0:1787602546.911789:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833734272 00000100:00100000:2.0:1787602546.912321:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 130 00000100:00100000:2.0:1787602546.912334:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+21:10564:x1874436833734272:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787602546.912388:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787602546.912516:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+21:10564:x1874436833734272:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 184us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602546.912524:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 130 00000100:00100000:2.0:1787602546.934297:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602546.934473:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833734528 00000100:00100000:1.0:1787602546.934483:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833734528 00000100:00100000:1.0:1787602546.934557:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 131 00000100:00100000:1.0:1787602546.934578:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+21:10564:x1874436833734528:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602546.934599:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602546.934631:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09dbaca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c254d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602546.934779:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbad1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602546.934797:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602546.934809:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602546.934822:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787602546.934981:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09dbaca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c254d expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602546.935000:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c254d expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602546.935009:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:1.0:1787602546.935027:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602546.935031:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eb200, rc 0) 00000100:00100000:1.0:1787602546.935106:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+23:10564:x1874436833734528:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 539us (819us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787602546.935114:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 131 00000100:00100000:1.0:1787602546.940267:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602546.940346:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833734784 00000100:00100000:2.0:1787602546.940357:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833734784 00000100:00100000:2.0:1787602546.940425:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 132 00000100:00100000:2.0:1787602546.940437:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+23:10564:x1874436833734784:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787602546.940519:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09dbadf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602546.940537:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09dbadf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602546.940549:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09dbadf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602546.940789:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09dbadf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602546.940797:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09dbadf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602546.940803:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09dbadf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602546.940809:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602546.940813:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09dbadf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602546.940819:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09dbadf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602546.940832:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:2.0:1787602546.940835:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787602546.940848:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09dbadf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602546.940853:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09dbadf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602546.941014:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+24:10564:x1874436833734784:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 577us (755us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787602546.941023:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 132 00000040:00080000:1.0:1787602546.941718:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602546.941724:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602546.942224:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787602546.942233:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787602546.943219:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602546.943358:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833734912 00000100:00100000:3.0:1787602546.943370:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833734912 00000100:00100000:3.0:1787602546.943434:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:3.0:1787602546.943445:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+24:2352:x1874436833734912:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602546.943462:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602546.943487:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbad1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c254d expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602546.943506:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:3.0:1787602546.943512:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602546.943563:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+23:2352:x1874436833734912:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 120us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602546.943585:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:1.0:1787602546.943738:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602546.944150:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833735168 00000100:00100000:3.0:1787602546.944157:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833735168 00000100:00100000:3.0:1787602546.944197:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 34 00000100:00100000:3.0:1787602546.944206:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+23:10564:x1874436833735168:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787602546.944436:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+24:10564:x1874436833735168:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 230us (698us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787602546.944444:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 34 00010000:00010000:0.0:1787602547.373028:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602548.401234:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787602548.478356:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1787602548.478497:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000040:00080000:0.0:1787602548.908713:0:12152:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787602548.908722:0:12152:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787602548.908795:0:12152:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787602548.908801:0:12152:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787602549.250219:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602549.250318:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833735424 00000100:00100000:2.0:1787602549.250329:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833735424 00000100:00100000:2.0:1787602549.250413:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 133 00000100:00100000:2.0:1787602549.250424:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+24:10584:x1874436833735424:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787602549.250448:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602549.250471:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbae6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2554 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602549.250592:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09dbaed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602549.250611:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09dbaed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602549.250625:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09dbaed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602549.250638:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00080000:3.0:1787602549.250849:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787602549.250952:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbae6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2554 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602549.250990:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09dbaed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2554 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602549.251000:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:2.0:1787602549.251004:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787602549.251009:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5600, rc 0) 00000100:00100000:2.0:1787602549.253793:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+26:10584:x1874436833735424:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 3360us (3575us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787602549.253806:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 133 00000100:00100000:3.0:1787602549.267301:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602549.267339:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833735552 00000100:00100000:3.0:1787602549.267349:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833735552 00000100:00100000:3.0:1787602549.267415:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 134 00000100:00100000:3.0:1787602549.267426:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+26:10584:x1874436833735552:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:3.0:1787602549.267495:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbafb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602549.267511:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbafb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602549.267523:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbafb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602549.267549:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbafb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602549.267556:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbafb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602549.267593:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbafb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602549.267599:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602549.267604:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbafb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602549.267610:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbafb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602549.267622:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:3.0:1787602549.267626:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787602549.267631:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbafb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602549.267638:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbafb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602549.267709:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+26:10584:x1874436833735552:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 284us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602549.267716:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 134 00000100:00100000:1.0:1787602549.358332:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853669120:0@lo:400:kworker.0 00000100:00100000:1.0:1787602549.358404:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602549.358472:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787602549.358478:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853668992:0@lo:400:kworker.0 00000100:00100000:1.0:1787602549.358501:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602549.358532:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853669120 00000100:00100000:1.0:1787602549.358539:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853669120 00000100:00100000:1.0:1787602549.358603:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787602549.358612:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874436853669120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602549.358660:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874436853669120:12345-0@lo:400:kworker.0 Request processed in 50us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602549.358667:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787602549.358690:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853668992 00000100:00100000:1.0:1787602549.358693:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853668992 00000100:00100000:1.0:1787602549.358721:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787602549.358727:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853668992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602549.358820:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853668992:12345-0@lo:400:kworker.0 Request processed in 93us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602549.358826:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787602549.358995:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853668864:0@lo:400:kworker.0 00000100:00100000:2.0:1787602549.359026:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602549.359042:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853669376:0@lo:400:kworker.0 00000100:00100000:2.0:1787602549.359058:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602549.359075:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787602549.359080:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853668736:0@lo:400:kworker.0 00000100:00100000:2.0:1787602549.359102:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602549.359124:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853669248:0@lo:400:kworker.0 00000100:00100000:2.0:1787602549.359142:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602549.359164:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853669376 00000100:00100000:2.0:1787602549.359168:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853669376 00000100:00100000:2.0:1787602549.359197:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787602549.359203:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853669376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602549.359238:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853669376:12345-0@lo:400:kworker.0 Request processed in 35us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602549.359254:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787602549.359277:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853668736 00000100:00100000:2.0:1787602549.359281:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853668736 00000100:00100000:2.0:1787602549.359303:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787602549.359310:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853668736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602549.359338:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853668736:12345-0@lo:400:kworker.0 Request processed in 29us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602549.359343:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787602549.359384:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853668736:0@lo:400:kworker.0 00000100:00100000:2.0:1787602549.359395:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787602549.359400:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1787602549.359419:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d353d5ad500, transno 4294967304 00000100:00100000:2.0:1787602549.359430:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853669376:0@lo:400:kworker.0 00000100:00080000:1.0:1787602549.359725:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787602549.359739:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602549.359772:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602549.359788:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853668864 00000100:00100000:1.0:1787602549.359792:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853668864 00000100:00100000:1.0:1787602549.359814:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853669248 00000100:00100000:1.0:1787602549.359817:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853669248 00000100:00100000:1.0:1787602549.359839:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787602549.359972:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853668864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602549.360017:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853668864:12345-0@lo:400:kworker.0 Request processed in 170us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602549.360024:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787602549.360037:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787602549.360043:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853669248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602549.360072:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853669248:12345-0@lo:400:kworker.0 Request processed in 29us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602549.360078:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787602549.360111:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853668992:0@lo:400:kworker.0 00000100:00100000:1.0:1787602549.360122:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853669120:0@lo:400:kworker.0 00000100:00100000:1.0:1787602549.360143:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853669248:0@lo:400:kworker.0 00000100:00100000:1.0:1787602549.360152:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853668864:0@lo:400:kworker.0 00000100:00080000:1.0:1787602549.360164:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787602549.428205:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602549.436542:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602549.440117:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833735680 00000100:00100000:1.0:1787602549.440133:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833735680 00000100:00100000:1.0:1787602549.440239:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:1.0:1787602549.440251:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2353:x1874436833735680:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:1.0:1787602549.440270:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602549.440297:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b888428/0x3640686da09dbb02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c255b expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787602549.440330:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8ca671, atime: 0x6a8ca671, ctime: 0x6a8ca671, blocks: 0xb 00000100:00080000:2.0:1787602549.440438:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787602549.440573:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=334s v=(0 0) 00010000:00010000:1.0:1787602549.440587:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602549.440600:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b888428/0x3640686da09dbb02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c255b expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602549.440622:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b888428/0x3640686da09dbb02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c255b expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602549.440638:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eb800, rc 0) 00000100:00100000:1.0:1787602549.440724:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2353:x1874436833735680:12345-192.168.201.26@tcp:101:cat.0 Request processed in 475us (4191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602549.440759:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:3.0:1787602549.456627:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602549.457300:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833735808 00000100:00100000:1.0:1787602549.457318:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833735808 00002000:00100000:1.0:1787602549.457391:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8d3534f0ce00 x1874436833735808/t0(0) o3->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:385/0 lens 488/0 e 0 to 0 dl 1787602560 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787602549.457405:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3534f0ce00 with x1874436833735808 ext(0->4095) 00002000:00010000:1.0:1787602549.457429:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3534f0ce00 00000100:00100000:1.0:1787602549.457477:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:1.0:1787602549.457489:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2354:x1874436833735808:12345-192.168.201.26@tcp:3:cat.0 00000100:00100000:1.0:1787602549.457899:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2354:x1874436833735808:12345-192.168.201.26@tcp:3:cat.0 Request processed in 410us (1286us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787602549.457909:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 3 00002000:00100000:1.0:1787602549.457916:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8d3534f0ce00 x1874436833735808/t0(0) o3->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:385/0 lens 488/4536 e 0 to 0 dl 1787602560 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787602549.457924:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3534f0ce00 with x1874436833735808 ext(0->4095) 00002000:00010000:1.0:1787602549.457927:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3534f0ce00 00000100:00100000:2.0:1787602549.869105:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853669504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602549.869254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602549.869410:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853669504 00000100:00100000:2.0:1787602549.869423:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853669504 00000100:00100000:2.0:1787602549.869506:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787602549.869519:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853669504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787602549.869592:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602549.869650:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853669504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602549.869658:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787602549.869714:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853669504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602549.985252:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602549.985304:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602549.985344:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602549.987310:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833736192 00000100:00100000:1.0:1787602549.987335:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833736192 00000100:00100000:1.0:1787602549.987455:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 146 00000100:00100000:1.0:1787602549.987469:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833736192:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602549.987601:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2352:x1874436833736192:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 134us (2295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602549.987609:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 146 00000100:00100000:2.0:1787602549.988520:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833735936 00000100:00100000:2.0:1787602549.988533:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833735936 00000100:00100000:2.0:1787602549.988607:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 292 00000100:00100000:2.0:1787602549.988618:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2352:x1874436833735936:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602549.988678:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2352:x1874436833735936:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 62us (3445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602549.988686:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 292 00000100:00080000:3.0:1787602549.989833:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602549.995871:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833736064 00000100:00100000:0.0:1787602549.995895:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833736064 00000100:00100000:0.0:1787602549.996031:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 83 00000100:00100000:0.0:1787602549.996045:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2352:x1874436833736064:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602549.996200:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2352:x1874436833736064:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 158us (10854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602549.996207:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 83 00000100:00080000:3.0:1787602549.997141:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787602550.445375:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787602550.998043:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000020:00080000:0.0:1787602550.998074:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d350af32e40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787602550.998081:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3503607700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d350af32000 00000020:00080000:0.0:1787602550.998084:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3503607100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d353d48f400 00000020:00080000:0.0:1787602550.998104:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1787602550.998113:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:0.0:1787602550.998126:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1787602550.998241:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787602550.998470:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000040:00080000:3.0:1787602551.034185:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787602551.034205:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787602551.034267:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787602551.034275:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1787602551.055202:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1787602551.055235:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:2.0:1787602551.476072:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602551.923647:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787602551.923688:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853669632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602551.923833:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602551.924216:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853669632 00000100:00100000:1.0:1787602551.924230:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853669632 00000100:00100000:1.0:1787602551.924324:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787602551.924339:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853669632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787602551.924706:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602551.924826:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853669632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 491us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602551.924836:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1787602551.926008:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602551.926240:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1787602551.926251:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1787602551.926293:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853669632:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787602552.500779:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602553.525548:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602554.477300:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853670144:0@lo:400:kworker.0 00000100:00100000:2.0:1787602554.477403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602554.477489:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787602554.477507:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853670016:0@lo:400:kworker.0 00000100:00100000:2.0:1787602554.477538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602554.477589:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853670144 00000100:00100000:2.0:1787602554.477600:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853670144 00000100:00100000:2.0:1787602554.477684:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787602554.477695:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853670144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602554.477784:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853670144:12345-0@lo:400:kworker.0 Request processed in 91us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602554.477792:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1787602554.477818:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602554.477881:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853670144:0@lo:400:kworker.0 00000100:00100000:3.0:1787602554.478344:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853670016 00000100:00100000:3.0:1787602554.478350:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853670016 00000100:00100000:3.0:1787602554.478400:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787602554.478409:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853670016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602554.478454:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853670016:12345-0@lo:400:kworker.0 Request processed in 47us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602554.478460:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787602554.478598:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853669888:0@lo:400:kworker.0 00000100:00100000:1.0:1787602554.478637:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602554.478670:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853670400:0@lo:400:kworker.0 00000100:00100000:1.0:1787602554.478695:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602554.478715:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787602554.478721:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853669760:0@lo:400:kworker.0 00000100:00100000:1.0:1787602554.478770:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602554.478796:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853670272:0@lo:400:kworker.0 00000100:00100000:1.0:1787602554.478817:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602554.478843:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853669760 00000100:00100000:1.0:1787602554.478847:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853669760 00000100:00100000:1.0:1787602554.478876:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787602554.478883:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853669760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602554.478933:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853669760:12345-0@lo:400:kworker.0 Request processed in 50us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602554.478939:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787602554.479428:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853669760:0@lo:400:kworker.0 00000100:00100000:3.0:1787602554.479535:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853669888 00000100:00100000:3.0:1787602554.479541:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853669888 00000100:00100000:3.0:1787602554.479590:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853670272 00000100:00100000:3.0:1787602554.479593:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853670272 00000100:00100000:3.0:1787602554.479611:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787602554.479618:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853669888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602554.479675:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853669888:12345-0@lo:400:kworker.0 Request processed in 57us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602554.479683:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787602554.479697:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787602554.479703:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853670272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602554.479731:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853670272:12345-0@lo:400:kworker.0 Request processed in 28us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602554.479737:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787602554.479803:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853670272:0@lo:400:kworker.0 00000100:00100000:3.0:1787602554.479815:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853669888:0@lo:400:kworker.0 00000100:00080000:2.0:1787602554.480219:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602554.480258:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853670016:0@lo:400:kworker.0 00000100:00100000:0.0:1787602554.480325:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853670400 00000100:00100000:0.0:1787602554.480331:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853670400 00000100:00100000:0.0:1787602554.480392:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1787602554.480401:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787602554.480403:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853670400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602554.480468:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853670400:12345-0@lo:400:kworker.0 Request processed in 69us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602554.480474:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787602554.481534:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853670400:0@lo:400:kworker.0 00010000:00010000:2.0:1787602554.544083:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602554.993523:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787602554.993567:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853670528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602554.993678:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602554.994521:0:10486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853670528 00000100:00100000:1.0:1787602554.994536:0:10486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853670528 00000100:00100000:1.0:1787602554.994617:0:10486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787602554.994648:0:10486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853670528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602554.994709:0:10486:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602554.994814:0:10486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853670528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602554.994823:0:10486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787602554.994887:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853670528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602555.097207:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602555.097255:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602555.097282:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602555.097433:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833736320 00000100:00100000:1.0:1787602555.097446:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833736320 00000100:00100000:1.0:1787602555.097524:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 294 00000100:00100000:1.0:1787602555.097539:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833736320:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602555.097652:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833736320:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 116us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602555.097661:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 294 00000100:00100000:2.0:1787602555.098070:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833736576 00000100:00100000:2.0:1787602555.098078:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833736576 00000100:00100000:2.0:1787602555.098144:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 86 00000100:00100000:2.0:1787602555.098153:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2354:x1874436833736576:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602555.098200:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2354:x1874436833736576:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 50us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602555.098207:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 86 00000100:00080000:1.0:1787602555.098385:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602555.098942:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833736832 00000100:00100000:2.0:1787602555.098949:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833736832 00000100:00100000:2.0:1787602555.099001:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 150 00000100:00100000:2.0:1787602555.099011:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2354:x1874436833736832:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602555.099062:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2354:x1874436833736832:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 54us (1779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602555.099069:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 150 00000100:00080000:1.0:1787602555.099375:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602555.122721:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602555.122814:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602555.122855:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833736704 00000100:00100000:2.0:1787602555.122870:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833736704 00000100:00100000:2.0:1787602555.122974:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 87 00000100:00100000:2.0:1787602555.122987:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833736704:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602555.123091:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833736704:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602555.123100:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 87 00000100:00080000:2.0:1787602555.123132:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787602555.136834:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833736448 00000100:00100000:1.0:1787602555.136859:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833736448 00000100:00100000:1.0:1787602555.136991:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 151 00000100:00100000:1.0:1787602555.137005:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+13:2354:x1874436833736448:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602555.137268:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+13:2354:x1874436833736448:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 264us (14563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602555.137289:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 151 00000100:00080000:2.0:1787602555.137419:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787602555.579201:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787602556.069940:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787602556.070007:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787602556.070027:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787602556.589501:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602556.711003:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602556.711282:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833736960 00000100:00100000:3.0:1787602556.711658:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833736960 00000100:00100000:3.0:1787602556.711792:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 135 00000100:00100000:3.0:1787602556.711804:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+13:10229:x1874436833736960:12345-192.168.201.26@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787602556.711920:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+13:10229:x1874436833736960:12345-192.168.201.26@tcp:60:lhsmtool_posix.0 Request processed in 118us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602556.711928:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 135 00000100:00100000:1.0:1787602556.719944:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602556.720165:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833737216 00000100:00100000:3.0:1787602556.720175:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833737216 00000100:00100000:3.0:1787602556.720312:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:3.0:1787602556.720324:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+13:10229:x1874436833737216:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787602556.720931:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+14:10229:x1874436833737216:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 606us (995us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787602556.720942:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:0.0:1787602556.911270:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602556.911610:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833737344 00000100:00100000:1.0:1787602556.911635:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833737344 00000100:00100000:1.0:1787602556.911698:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 136 00000100:00100000:1.0:1787602556.911709:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+5:11037:x1874436833737344:12345-192.168.201.26@tcp:101:lsof.0 00010000:00010000:1.0:1787602556.911731:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602556.911781:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbb09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2562 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602556.911862:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbb10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602556.911877:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbb10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602556.911889:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbb10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602556.912135:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787602556.912141:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602556.912247:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbb10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602556.912277:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbb09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2562 expref: 7 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602556.912297:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbb10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2562 expref: 6 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602556.912307:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:1.0:1787602556.912310:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602556.912314:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eac00, rc 0) 00000100:00100000:1.0:1787602556.912690:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+6:11037:x1874436833737344:12345-192.168.201.26@tcp:101:lsof.0 Request processed in 981us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602556.912698:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 136 00000100:00100000:2.0:1787602557.037381:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853670656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602557.037527:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602557.037647:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853670656 00000100:00100000:2.0:1787602557.037658:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853670656 00000100:00080000:3.0:1787602557.038101:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602557.038150:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787602557.038167:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353c9c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853670656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602557.038216:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602557.038294:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353c9c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853670656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602557.049216:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853670656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602557.055050:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:2.0:1787602557.613605:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602558.637208:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602559.597368:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853670784:0@lo:400:kworker.0 00000100:00100000:0.0:1787602559.597484:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602559.597598:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853670784 00000100:00100000:2.0:1787602559.597608:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853670784 00000100:00100000:2.0:1787602559.597670:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787602559.597680:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853670784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602559.597863:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853670912:0@lo:400:kworker.0 00000100:00100000:1.0:1787602559.597910:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602559.597958:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853670912 00000100:00100000:1.0:1787602559.597961:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853670912 00000100:00100000:1.0:1787602559.597991:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787602559.597998:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853670912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602559.598038:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853670912:12345-0@lo:400:kworker.0 Request processed in 40us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602559.598046:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787602559.598089:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853670912:0@lo:400:kworker.0 00000100:00100000:2.0:1787602559.601644:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853670784:12345-0@lo:400:kworker.0 Request processed in 3950us (4144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602559.601691:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787602559.604481:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853671424:0@lo:400:kworker.0 00000100:00100000:3.0:1787602559.604561:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602559.604608:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787602559.604613:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853671296:0@lo:400:kworker.0 00000100:00100000:3.0:1787602559.604635:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602559.604676:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853671424 00000100:00100000:3.0:1787602559.604684:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853671424 00000100:00100000:1.0:1787602559.605014:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853671168:0@lo:400:kworker.0 00000100:00100000:1.0:1787602559.605052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602559.605079:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787602559.605085:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853671040:0@lo:400:kworker.0 00000100:00100000:1.0:1787602559.605109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602559.605139:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853671168 00000100:00100000:1.0:1787602559.605143:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853671168 00000100:00080000:2.0:1787602559.605240:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787602559.605246:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787602559.605267:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853671296 00000100:00100000:2.0:1787602559.605271:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853671296 00000100:00100000:2.0:1787602559.605314:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853671040 00000100:00100000:2.0:1787602559.605317:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853671040 00000100:00100000:2.0:1787602559.605343:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787602559.605354:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853671296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602559.605441:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853671296:12345-0@lo:400:kworker.0 Request processed in 88us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602559.605449:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787602559.605467:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787602559.605474:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853671040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602559.605507:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853671040:12345-0@lo:400:kworker.0 Request processed in 33us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602559.605513:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1787602559.605529:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602559.605575:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853671296:0@lo:400:kworker.0 00000100:00100000:3.0:1787602559.606937:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787602559.606984:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853671424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602559.607092:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853671424:12345-0@lo:400:kworker.0 Request processed in 116us (2529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602559.607100:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787602559.608174:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853671424:0@lo:400:kworker.0 00000100:00100000:2.0:1787602559.608254:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853671040:0@lo:400:kworker.0 00000100:00100000:0.0:1787602559.608535:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853670784:0@lo:400:kworker.0 00000100:00100000:1.0:1787602559.609974:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787602559.610001:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853671168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602559.610133:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853671168:12345-0@lo:400:kworker.0 Request processed in 146us (5080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602559.610140:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787602559.610984:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853671168:0@lo:400:kworker.0 00010000:00010000:0.0:1787602559.661528:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602560.109224:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853671552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602560.109326:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602560.109559:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853671552 00000100:00100000:1.0:1787602560.109584:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853671552 00000100:00100000:1.0:1787602560.109634:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787602560.109643:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853671552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602560.109681:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602560.109734:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853671552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602560.109867:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787602560.110068:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853671552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602560.217011:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602560.217083:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602560.217240:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833737472 00000100:00100000:1.0:1787602560.217254:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833737472 00000100:00100000:1.0:1787602560.217341:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 296 00000100:00100000:1.0:1787602560.217354:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2353:x1874436833737472:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602560.217483:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2353:x1874436833737472:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 131us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602560.217491:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 296 00000100:00100000:2.0:1787602560.217946:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602560.217978:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602560.218006:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602560.218055:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833737984 00000100:00100000:1.0:1787602560.218060:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833737984 00000100:00100000:1.0:1787602560.218109:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833737600 00000100:00100000:1.0:1787602560.218112:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833737600 00000100:00100000:1.0:1787602560.218138:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 155 00000100:00100000:1.0:1787602560.218146:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+6:2353:x1874436833737984:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602560.218197:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+6:2353:x1874436833737984:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 51us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602560.218205:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 155 00000100:00100000:1.0:1787602560.218219:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 156 00000100:00100000:1.0:1787602560.218225:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+14:2353:x1874436833737600:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602560.218257:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+14:2353:x1874436833737600:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 33us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602560.218283:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 156 00000100:00080000:1.0:1787602560.218318:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602560.231023:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833737728 00000100:00100000:0.0:1787602560.231048:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833737728 00000100:00100000:1.0:1787602560.231211:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833737856 00000100:00100000:1.0:1787602560.231216:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833737856 00000100:00100000:0.0:1787602560.234831:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 90 00000100:00100000:0.0:1787602560.234857:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2353:x1874436833737728:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602560.234985:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2353:x1874436833737728:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 141us (17901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602560.234995:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 90 00000100:00080000:3.0:1787602560.236605:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787602560.236617:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602560.237256:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 91 00000100:00100000:1.0:1787602560.237272:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2353:x1874436833737856:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602560.237375:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2353:x1874436833737856:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 108us (19367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602560.237383:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 91 00010000:00010000:2.0:1787602560.701219:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787602561.268318:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787602561.268332:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787602561.268955:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787602561.268963:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1787602561.286920:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000001:02000400:2.0:1787602561.613855:0:12355:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 16:16:00 (1787602560) 00010000:00010000:2.0:1787602561.710250:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602562.157111:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853671680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602562.157214:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602562.157348:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853671680 00000100:00100000:1.0:1787602562.157357:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853671680 00000100:00100000:1.0:1787602562.157437:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787602562.157455:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853671680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787602562.157494:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602562.157544:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853671680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602562.157553:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787602562.157599:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853671680:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787602562.157962:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787602562.733726:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602563.317656:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602563.321077:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833738240 00000100:00100000:1.0:1787602563.321092:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833738240 00000100:00100000:1.0:1787602563.321186:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 137 00000100:00100000:1.0:1787602563.321199:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+13:11301:x1874436833738240:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602563.321565:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602563.321590:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dbb17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2569 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.321997:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbb1e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.322014:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbb1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.322028:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbb1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.322044:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09dbb25 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.322051:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09dbb25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.322058:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09dbb25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787602563.322391:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787602563.323123:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbb2c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.323138:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbb2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.323145:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbb2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602563.323157:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787602563.324140:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbb1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.324154:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbb1e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.324169:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbb1e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.324176:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602563.324180:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbb1e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.324188:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbb1e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.324202:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d3504d95900) 00010000:00010000:1.0:1787602563.324205:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602563.324209:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbb1e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.324674:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbb1e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.324692:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09dbb25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.324699:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09dbb25 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.324705:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09dbb25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.324710:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602563.324714:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09dbb25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.324729:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09dbb25 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.324738:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d350cd81000) 00010000:00010000:1.0:1787602563.324740:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602563.324791:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09dbb25 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.324797:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09dbb25 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.326795:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dbb17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2569 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.326824:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbb2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2569 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602563.326835:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d350b502400) 00010000:00010000:1.0:1787602563.326838:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602563.326841:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eb200, rc 0) 00000100:00100000:1.0:1787602563.326980:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+15:11301:x1874436833738240:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 5782us (9332us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787602563.326990:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 137 00000100:00100000:2.0:1787602563.344150:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602563.344189:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602563.344249:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833738368 00000100:00100000:1.0:1787602563.344258:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833738368 00000100:00100000:1.0:1787602563.344314:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 138 00000100:00100000:1.0:1787602563.344324:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+15:11301:x1874436833738368:12345-192.168.201.26@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787602563.344466:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+15:11301:x1874436833738368:12345-192.168.201.26@tcp:59:lhsmtool_posix.0 Request processed in 143us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602563.344474:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 138 00000100:00100000:0.0:1787602563.344536:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833738496 00000100:00100000:0.0:1787602563.344542:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833738496 00000100:00100000:0.0:1787602563.344587:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:0.0:1787602563.344595:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+15:2354:x1874436833738496:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602563.344612:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602563.344637:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbb2c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2569 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602563.344657:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d350b502400) 00010000:00010000:0.0:1787602563.344663:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602563.344684:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+14:2354:x1874436833738496:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 90us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602563.344690:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00010000:00010000:2.0:1787602563.757011:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787602564.333956:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787602564.333966:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787602564.334568:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787602564.334578:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787602564.717879:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853672064:0@lo:400:kworker.0 00000100:00100000:3.0:1787602564.717954:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602564.718021:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787602564.718028:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853672192:0@lo:400:kworker.0 00000100:00100000:3.0:1787602564.718056:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602564.718095:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853672064 00000100:00100000:3.0:1787602564.718103:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853672064 00000100:00100000:3.0:1787602564.718157:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787602564.718166:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853672064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602564.718216:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853672064:12345-0@lo:400:kworker.0 Request processed in 51us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602564.718223:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787602564.718245:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853672192 00000100:00100000:3.0:1787602564.718248:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853672192 00000100:00100000:3.0:1787602564.718274:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787602564.718280:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853672192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602564.718335:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853672192:12345-0@lo:400:kworker.0 Request processed in 55us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602564.718341:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1787602564.718356:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787602564.718360:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602564.718484:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853671936:0@lo:400:kworker.0 00000100:00100000:1.0:1787602564.718525:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602564.718548:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d4b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853672448:0@lo:400:kworker.0 00000100:00100000:1.0:1787602564.718569:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602564.718589:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787602564.718595:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853671808:0@lo:400:kworker.0 00000100:00100000:1.0:1787602564.718623:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602564.718643:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853672320:0@lo:400:kworker.0 00000100:00100000:1.0:1787602564.718661:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602564.718683:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853671936 00000100:00100000:1.0:1787602564.718687:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853671936 00000100:00100000:1.0:1787602564.718707:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853672320 00000100:00100000:1.0:1787602564.718709:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853672320 00000100:00100000:1.0:1787602564.718727:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787602564.718733:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853671936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602564.718788:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853671936:12345-0@lo:400:kworker.0 Request processed in 54us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602564.718794:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787602564.718806:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787602564.718812:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853672320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602564.718835:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853672320:12345-0@lo:400:kworker.0 Request processed in 24us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602564.718851:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787602564.718870:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853672448 00000100:00100000:1.0:1787602564.718873:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853672448 00000100:00100000:1.0:1787602564.718894:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787602564.718900:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853672448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602564.718930:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853672448:12345-0@lo:400:kworker.0 Request processed in 30us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602564.718936:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787602564.718952:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853671808 00000100:00100000:1.0:1787602564.718955:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853671808 00000100:00100000:1.0:1787602564.718976:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787602564.718982:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853671808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602564.719008:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3302:x1874436853671808:12345-0@lo:400:kworker.0 Request processed in 27us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602564.719015:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787602564.719056:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853671808:0@lo:400:kworker.0 00000100:00100000:1.0:1787602564.719068:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853672320:0@lo:400:kworker.0 00000100:00100000:1.0:1787602564.719076:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853671936:0@lo:400:kworker.0 00000100:00100000:1.0:1787602564.719084:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d4b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853672448:0@lo:400:kworker.0 00000100:00100000:3.0:1787602564.719278:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853672192:0@lo:400:kworker.0 00000100:00100000:3.0:1787602564.719297:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853672064:0@lo:400:kworker.0 00000100:00080000:3.0:1787602564.719331:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787602564.719335:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787602564.781005:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602565.234918:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853672576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602565.235014:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602565.235090:0:10486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853672576 00000100:00100000:3.0:1787602565.235098:0:10486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853672576 00000100:00100000:3.0:1787602565.235145:0:10486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787602565.235155:0:10486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853672576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602565.235189:0:10486:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602565.235232:0:10486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853672576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602565.235239:0:10486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787602565.235281:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853672576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602565.343595:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602565.343656:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602565.343689:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602565.343779:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602565.343826:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833738880 00000100:00100000:0.0:1787602565.343836:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833738880 00000100:00100000:0.0:1787602565.343892:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833739008 00000100:00100000:0.0:1787602565.343895:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833739008 00000100:00100000:0.0:1787602565.343921:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 94 00000100:00100000:0.0:1787602565.343932:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2353:x1874436833738880:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602565.344008:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2353:x1874436833738880:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 78us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602565.344016:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 94 00000100:00100000:0.0:1787602565.344034:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:0.0:1787602565.344041:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2350:x1874436833739008:12345-192.168.201.26@tcp:9:kworker.0 00000020:00000080:0.0:1787602565.344060:0:8625:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db4fe 00000100:00080000:0.0:1787602565.344068:0:8625:0:(import.c:65:import_set_state_nolock()) ffff8d353d25f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787602565.344125:0:8625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967304 00000100:00100000:0.0:1787602565.344383:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+2:2350:x1874436833739008:12345-192.168.201.26@tcp:9:kworker.0 Request processed in 341us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602565.344390:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 47 00010000:00010000:0.0:1787602565.344410:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602565.344612:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833738624 00000100:00100000:1.0:1787602565.344617:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833738624 00000100:00100000:1.0:1787602565.344650:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 298 00000100:00100000:1.0:1787602565.344658:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2353:x1874436833738624:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602565.344686:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2353:x1874436833738624:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 30us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602565.344701:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 298 00000100:00100000:1.0:1787602565.344735:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833738752 00000100:00100000:1.0:1787602565.344774:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833738752 00000100:00100000:1.0:1787602565.344805:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 160 00000100:00100000:1.0:1787602565.344811:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+14:2353:x1874436833738752:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602565.344840:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+14:2353:x1874436833738752:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 30us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602565.344846:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 160 00000100:00080000:1.0:1787602565.355959:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787602565.355971:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602565.355974:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602565.358603:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602565.358652:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833739136 00000100:00100000:1.0:1787602565.358661:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833739136 00000100:00100000:1.0:1787602565.358721:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 161 00000100:00100000:1.0:1787602565.358733:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+6:2354:x1874436833739136:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602565.358835:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:334d0685-d8e1-4308-8cca-e2aac90898dd+6:2354:x1874436833739136:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 104us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602565.358842:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 161 00000100:00080000:1.0:1787602565.358867:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602565.502050:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602565.502128:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833739264 00000100:00100000:3.0:1787602565.502139:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833739264 00000100:00100000:3.0:1787602565.502203:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 139 00000100:00100000:3.0:1787602565.502215:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+14:11344:x1874436833739264:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602565.502238:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602565.502273:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbb3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2570 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502364:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dbb41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502380:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dbb41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502394:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dbb41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502410:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbb48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502416:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbb48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502422:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbb48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502724:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dbb41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502733:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dbb41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502775:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dbb41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502783:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602565.502787:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dbb41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502806:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dbb41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502819:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:3.0:1787602565.502822:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602565.502827:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dbb41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502833:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dbb41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502845:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbb48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502851:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbb48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502857:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbb48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502862:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602565.502865:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbb48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502871:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbb48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502878:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d3529dc7c00) 00010000:00010000:3.0:1787602565.502880:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602565.502883:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbb48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502900:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbb48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502933:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbb3a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2570 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502943:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:3.0:1787602565.502946:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602565.502949:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbb3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2570 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.502956:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432e00, rc 0) 00000100:00100000:3.0:1787602565.503027:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+14:11344:x1874436833739264:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 813us (987us total) trans 0 rc 301/301 00000100:00100000:3.0:1787602565.503036:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 139 00000100:00100000:0.0:1787602565.510863:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602565.510954:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833739520 00000100:00100000:3.0:1787602565.510965:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833739520 00000100:00100000:3.0:1787602565.511029:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 140 00000100:00100000:3.0:1787602565.511040:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+14:11344:x1874436833739520:12345-192.168.201.26@tcp:36:lfs.0 00010000:00010000:3.0:1787602565.511097:0:8208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602565.511135:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09db4b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23a9 expref: 14 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.511155:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:3.0:1787602565.511159:0:8208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602565.511467:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dbb4f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.511489:0:8208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbb10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2562 expref: 5 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.511499:0:8208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dbb4f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.511530:0:8208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbb10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2562 expref: 5 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.511545:0:8208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbb10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2562 expref: 5 pid: 8208 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602565.511560:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405fa5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853672704:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787602565.511808:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a0f0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787602565.517846:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602565.517883:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833739648 00000100:00100000:3.0:1787602565.517893:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833739648 00010000:00010000:3.0:1787602565.517938:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbb10 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2562 expref: 6 pid: 8208 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602565.517974:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 62 00000100:00100000:3.0:1787602565.517984:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+6:2352:x1874436833739648:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602565.517998:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602565.518005:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbb10 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2562 expref: 6 pid: 8208 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.518018:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbb10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2562 expref: 6 pid: 8208 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.518050:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:3.0:1787602565.518056:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dbb4f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.518066:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dbb4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.518073:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dbb4f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602565.518094:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602565.518161:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+6:2352:x1874436833739648:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 178us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602565.518171:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 62 00010000:00010000:0.0:1787602565.521249:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbb10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2562 expref: 5 pid: 8208 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602565.521274:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405fa5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853672704:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787602565.521314:0:8208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dbb4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.521327:0:8208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dbb4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.521333:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dbb4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.529310:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbb56 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.529335:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbb56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.529349:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbb56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602565.534964:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787602565.534984:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dbb4f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.535000:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dbb4f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.535008:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dbb4f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.535014:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602565.535020:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dbb4f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.535028:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dbb4f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.535045:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:0.0:1787602565.535048:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602565.535053:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dbb4f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.535060:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dbb4f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787602565.535081:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a020074 reply state 00000000d04ac8e2 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbb56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602565.535092:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602565.535198:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+15:11344:x1874436833739520:12345-192.168.201.26@tcp:36:lfs.0 Request processed in 24154us (24341us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787602565.535208:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 140 00010000:00010000:0.0:1787602565.539125:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbb56 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.539158:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbb56 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.539166:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbb56 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.539172:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602565.539177:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbb56 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.539185:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbb56 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.539204:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d350b502900) 00010000:00010000:0.0:1787602565.539207:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602565.539212:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbb56 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.539218:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbb56 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602565.659026:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602565.665731:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833739776 00000100:00100000:1.0:1787602565.665763:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833739776 00000100:00100000:0.0:1787602565.674406:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 141 00000100:00100000:0.0:1787602565.674427:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+14:11352:x1874436833739776:12345-192.168.201.26@tcp:101:lctl.0 00010000:00010000:0.0:1787602565.674463:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602565.674492:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbb5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2577 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.674566:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2c00/0x3640686da09dbb64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.674610:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2c00/0x3640686da09dbb64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.674632:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2c00/0x3640686da09dbb64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602565.674710:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787602565.674715:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602565.674781:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2c00/0x3640686da09dbb64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.674808:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbb5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2577 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.674828:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2c00/0x3640686da09dbb64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2577 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602565.674837:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502900) 00010000:00010000:0.0:1787602565.674840:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787602565.674843:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2c00, rc 0) 00000100:00100000:0.0:1787602565.674919:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+15:11352:x1874436833739776:12345-192.168.201.26@tcp:101:lctl.0 Request processed in 498us (16303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602565.674926:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 141 00000100:00100000:3.0:1787602565.770012:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602565.771583:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833739904 00000100:00100000:0.0:1787602565.771663:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833739904 00000100:00100000:2.0:1787602565.775255:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 142 00000100:00100000:2.0:1787602565.775274:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+15:11358:x1874436833739904:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787602565.775328:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602565.775353:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09dbb6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c257e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.775441:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbb72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.775455:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbb72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.775467:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbb72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.775508:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbb79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.775516:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbb79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.775522:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbb79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.775664:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09dbb80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.775674:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09dbb80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.775681:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09dbb80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602565.775714:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787602565.775718:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602565.775768:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09dbb80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.775782:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbb72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.775788:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbb72 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.775795:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbb72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.776013:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602565.776018:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbb72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.776025:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbb72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.776040:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502900) 00010000:00010000:2.0:1787602565.776043:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602565.776047:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbb72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.776053:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbb72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.776069:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbb79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.776075:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbb79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.776080:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbb79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.776085:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602565.776088:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbb79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.776094:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbb79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.776189:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d3504d95300) 00010000:00010000:2.0:1787602565.776191:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602565.776194:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbb79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.776200:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbb79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.776234:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09dbb6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c257e expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.776248:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09dbb80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c257e expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.776256:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:2.0:1787602565.776258:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787602565.776260:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4800, rc 0) 00000100:00100000:2.0:1787602565.776348:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+16:11358:x1874436833739904:12345-192.168.201.26@tcp:101:bash.0 Request processed in 1078us (6346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602565.780167:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602565.780282:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833740160 00000100:00100000:1.0:1787602565.780295:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833740160 00000100:00100000:2.0:1787602565.788846:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 142 00000100:00100000:1.0:1787602565.790693:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 143 00000100:00100000:1.0:1787602565.790722:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+16:11358:x1874436833740160:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787602565.790776:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602565.790814:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbb87 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2585 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.790979:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09dbb8e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.790994:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09dbb8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.791007:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09dbb8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.791069:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbb95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.791077:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbb95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.791084:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbb95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787602565.792590:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787602565.794032:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbb9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.794054:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbb9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.794066:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbb9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.794140:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09dbb8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.794147:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09dbb8e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.794153:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09dbb8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.794160:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ebc00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602565.794165:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09dbb8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.794173:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09dbb8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.794189:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:1.0:1787602565.794193:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602565.794198:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09dbb8e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.794204:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebc00/0x3640686da09dbb8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602565.794221:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009671ab7b reply state 0000000086490729 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbb95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602565.794231:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787602565.794272:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbb87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2585 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.794311:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbb9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2585 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.794319:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81a00) 00010000:00010000:1.0:1787602565.794322:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602565.794325:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eaa00, rc 0) 00000100:00100000:1.0:1787602565.796276:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+19:11358:x1874436833740160:12345-192.168.201.26@tcp:101:bash.0 Request processed in 5555us (16106us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787602565.796289:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 143 00010000:00010000:1.0:1787602565.800278:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbb95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.800307:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbb95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.800316:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbb95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.800322:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eba00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602565.800328:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbb95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.800335:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbb95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.800352:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d350cd81000) 00010000:00010000:1.0:1787602565.800354:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602565.800359:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbb95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.800392:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbb95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.805778:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602565.806045:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602565.806706:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833740288 00000100:00100000:1.0:1787602565.806719:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833740288 00000100:00100000:1.0:1787602565.806780:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:1.0:1787602565.806791:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1874436833740288:12345-192.168.201.26@tcp:8:bash.0 00010000:00080000:1.0:1787602565.806848:0:8625:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp t0 exp 0000000000000000 cur 350 last 0 00000020:00000080:1.0:1787602565.806890:0:8625:0:(genops.c:1385:class_connect()) connect: client e3aefeab-67b4-4a0a-9090-6916c4553638, cookie 0x3640686da09dbbaa 00002000:00100000:1.0:1787602565.806905:0:8625:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e3aefeab-67b4-4a0a-9090-6916c4553638/ffff8d353cc88000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787602565.806918:0:8625:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787602565.807044:0:8625:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787602565.807078:0:8625:0:(import.c:65:import_set_state_nolock()) ffff8d353cc8f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602565.807960:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2350:x1874436833740288:12345-192.168.201.26@tcp:8:bash.0 Request processed in 1164us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602565.807970:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:0.0:1787602565.817183:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602565.817578:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833740416 00000100:00100000:1.0:1787602565.817588:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833740416 00000100:00100000:1.0:1787602565.818142:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:1.0:1787602565.818154:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+6:0:x1874436833740416:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787602565.818174:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602565.818200:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dbbb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c258c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787602565.818229:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602565.818261:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1787602565.818265:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602565.818275:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dbbb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c258c expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.818294:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dbbb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c258c expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.818319:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eae00, rc 0) 00000100:00100000:1.0:1787602565.818547:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+7:0:x1874436833740416:12345-192.168.201.26@tcp:101:bash.0 Request processed in 394us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602565.818553:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00080000:2.0:1787602565.822198:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787602565.823932:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602565.826890:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833740544 00000100:00100000:1.0:1787602565.826909:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833740544 00000100:00100000:1.0:1787602565.826983:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 50 00000100:00100000:1.0:1787602565.826996:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:11358:x1874436833740544:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787602565.827017:0:8625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602565.827038:0:8625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2593 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.827076:0:8625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dbbb1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c258c expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.827086:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602565.827091:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602565.827097:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2593 expref: 8 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.827162:0:8625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dbbb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c258c expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.827177:0:8625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dbbb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c258c expref: 8 pid: 6689 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602565.827191:0:8625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c837480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1874436853672832:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602565.827320:0:8625:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353976f540 going to sleep for 11 seconds 00000100:00100000:2.0:1787602565.844817:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602565.844864:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833740672 00000100:00100000:2.0:1787602565.844872:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833740672 00010000:00010000:2.0:1787602565.844913:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dbbb1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c258c expref: 9 pid: 6689 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602565.844964:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 63 00000100:00100000:2.0:1787602565.844973:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+9:2352:x1874436833740672:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602565.844988:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602565.845010:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dbbb1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c258c expref: 9 pid: 6689 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.845023:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dbbb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c258c expref: 9 pid: 6689 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.845045:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602565.845049:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602565.845057:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2593 expref: 9 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.845065:0:11167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2593 expref: 9 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602565.845100:0:11167:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2593 expref: 9 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.845551:0:8625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dbbb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c258c expref: 9 pid: 6689 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602565.845568:0:8625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c837480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1874436853672832:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602565.845604:0:8625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2593 expref: 8 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.845617:0:8625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eba00, rc 0) 00000100:00100000:1.0:1787602565.845678:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+8:11358:x1874436833740544:12345-192.168.201.26@tcp:101:bash.0 Request processed in 18684us (21757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602565.845686:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 50 00000100:00100000:2.0:1787602565.846814:0:11167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11167:1874436853672960:192.168.201.26@tcp:105: 00000100:00100000:2.0:1787602565.846883:0:11167:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350c832180 going to sleep for 11 seconds 00000100:00100000:3.0:1787602565.850279:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602565.850434:0:11167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11167:1874436853672960:192.168.201.26@tcp:105: 00010000:00010000:2.0:1787602565.850487:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602565.850563:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2352:x1874436833740672:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 5590us (5756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602565.850576:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 63 00000100:00100000:0.0:1787602565.855850:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833740928 00000100:00100000:0.0:1787602565.855868:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833740928 00000100:00100000:1.0:1787602565.856067:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:1.0:1787602565.856079:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+18:11358:x1874436833740928:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:1.0:1787602565.856868:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+19:11358:x1874436833740928:12345-192.168.201.26@tcp:35:bash.0 Request processed in 788us (6594us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787602565.856891:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:3.0:1787602565.954100:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602565.959709:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833741184 00000100:00100000:0.0:1787602565.959728:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833741184 00000100:00100000:1.0:1787602565.959935:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 144 00000100:00100000:1.0:1787602565.959947:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+19:11368:x1874436833741184:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787602565.959973:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602565.959999:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbbbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c259a expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602565.960284:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787602565.960444:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbbbf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c259a expref: 21 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.960459:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502900) 00010000:00010000:1.0:1787602565.960463:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602565.960468:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbbbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c259a expref: 21 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602565.960484:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eae00, rc 0) 00000100:00100000:1.0:1787602565.960659:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+20:11368:x1874436833741184:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 712us (6570us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1787602565.960666:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 144 00000100:00100000:3.0:1787602565.968707:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602565.969338:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833741440 00000100:00100000:1.0:1787602565.969350:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833741440 00000100:00100000:1.0:1787602565.969411:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 37 00000100:00100000:1.0:1787602565.969421:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+20:11368:x1874436833741440:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787602565.969722:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+21:11368:x1874436833741440:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 301us (1025us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787602565.969771:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 37 00000100:00100000:2.0:1787602566.045876:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602566.046002:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833741568 00000100:00100000:0.0:1787602566.046014:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833741568 00000100:00100000:0.0:1787602566.046081:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 145 00000100:00100000:0.0:1787602566.046092:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+21:11374:x1874436833741568:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602566.046119:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602566.046141:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbbcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c25a1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.046233:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbbd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.046248:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.046272:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602566.046353:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787602566.046358:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602566.046402:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.046435:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbbcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25a1 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.046464:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbbd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25a1 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.046474:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:0.0:1787602566.046491:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787602566.046495:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e3e00, rc 0) 00000100:00100000:0.0:1787602566.046559:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+22:11374:x1874436833741568:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 469us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602566.046567:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 145 00000100:00100000:3.0:1787602566.050092:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602566.050205:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833741824 00000100:00100000:2.0:1787602566.050217:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833741824 00000100:00100000:2.0:1787602566.050304:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 146 00000100:00100000:2.0:1787602566.050316:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+22:11374:x1874436833741824:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787602566.050340:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602566.050364:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbbdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c25a8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.050480:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbbe2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.050496:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbbe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.050507:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbbe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602566.050520:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787602566.051579:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbbdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25a8 expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.052977:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbbe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25a8 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.053014:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81a00) 00010000:00010000:2.0:1787602566.053017:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602566.053022:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5a00, rc 0) 00000100:00100000:2.0:1787602566.053094:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+24:11374:x1874436833741824:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 2779us (3011us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1787602566.053105:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 146 00000100:00100000:3.0:1787602566.057963:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602566.058022:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602566.058122:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833742208 00000100:00100000:2.0:1787602566.058135:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833742208 00000100:00100000:2.0:1787602566.058217:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:2.0:1787602566.058229:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+24:2351:x1874436833742208:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602566.058246:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602566.058303:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbbe2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25a8 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.058327:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81a00) 00010000:00010000:2.0:1787602566.058333:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602566.058414:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+23:2351:x1874436833742208:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 187us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602566.058424:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:0.0:1787602566.058697:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833742080 00000100:00100000:0.0:1787602566.058704:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833742080 00000100:00100000:0.0:1787602566.058780:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 147 00000100:00100000:0.0:1787602566.058790:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+23:11374:x1874436833742080:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602566.058812:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602566.058829:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbbf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c25af expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.058939:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbbf7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.058954:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbbf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.058965:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbbf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602566.058978:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787602566.059112:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbbf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25af expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.059130:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbbf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25af expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.059228:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81a00) 00010000:00010000:0.0:1787602566.059231:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787602566.059234:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2000, rc 0) 00000100:00100000:0.0:1787602566.059285:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+25:11374:x1874436833742080:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 496us (1334us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787602566.059304:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 147 00000100:00100000:1.0:1787602566.066222:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602566.066412:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833742336 00000100:00100000:2.0:1787602566.066423:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833742336 00000100:00100000:2.0:1787602566.066479:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:2.0:1787602566.066489:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2353:x1874436833742336:12345-192.168.201.26@tcp:1:lfs.0 00010000:00010000:2.0:1787602566.066532:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09dbc05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.066565:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2593 expref: 7 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.066574:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787602566.066579:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602566.066592:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09dbc05 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.066629:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2593 expref: 7 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.066643:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2593 expref: 7 pid: 8625 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602566.066659:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1874436853673088:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602566.066778:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350c832180 going to sleep for 11 seconds 00000100:00100000:2.0:1787602566.077327:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6689:1874436853673088:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602566.077368:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09dbc05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602566.078870:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602566.079199:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833742464 00000100:00100000:3.0:1787602566.079211:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833742464 00002000:00100000:3.0:1787602566.079265:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d353d4b6680 x1874436833742464/t0(0) o4->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:402/0 lens 504/0 e 0 to 0 dl 1787602577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787602566.079276:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d353d4b6680 with x1874436833742464 ext(0->12) 00010000:00010000:3.0:1787602566.079312:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2593 expref: 8 pid: 8625 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.079328:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2593 expref: 8 pid: 8625 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787602566.079336:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d353d4b6680 00000100:00100000:3.0:1787602566.079379:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:3.0:1787602566.079390:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2352:x1874436833742464:12345-192.168.201.26@tcp:4:lfs.0 00000001:00100000:0.0:1787602566.145288:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e3aefeab-67b4-4a0a-9090-6916c4553638 00000020:00000080:0.0:1787602566.145307:0:7646:0:(genops.c:885:class_export_put()) final put ffff8d3534d8d000/e3aefeab-67b4-4a0a-9090-6916c4553638 00000001:00100000:0.0:1787602566.145335:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e3aefeab-67b4-4a0a-9090-6916c4553638 00000020:00000080:3.0:1787602566.146119:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3534d8d000/e3aefeab-67b4-4a0a-9090-6916c4553638 for lustre-OST0001 00000020:00000080:3.0:1787602566.146177:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d353d25f000 for lustre-OST0001 00000001:00080000:0.0:1787602566.199323:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1787602566.199770:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2352:x1874436833742464:12345-192.168.201.26@tcp:4:lfs.0 Request processed in 120355us (120881us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787602566.199781:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 2 00002000:00100000:3.0:1787602566.199794:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d353d4b6680 x1874436833742464/t4294967305(0) o4->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:402/0 lens 504/448 e 0 to 0 dl 1787602577 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787602566.199801:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d353d4b6680 with x1874436833742464 ext(0->12) 00010000:00010000:3.0:1787602566.199809:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2593 expref: 7 pid: 8625 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.199823:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2593 expref: 7 pid: 8625 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787602566.199829:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d353d4b6680 00000100:00100000:1.0:1787602566.202678:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602566.202816:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833742592 00000100:00100000:3.0:1787602566.202838:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833742592 00010000:00010000:3.0:1787602566.202875:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2593 expref: 7 pid: 8625 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602566.202912:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00100000:3.0:1787602566.202921:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833742592:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602566.202937:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787602566.202959:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787602566.202962:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787602566 00002000:00010000:3.0:1787602566.202965:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787602567 00002000:00010000:3.0:1787602566.202967:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787602566 00002000:00010000:3.0:1787602566.202969:0:5823:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1787602566.202976:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2593 expref: 7 pid: 8625 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.202992:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2593 expref: 7 pid: 8625 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.203017:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dbbb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2593 expref: 7 pid: 8625 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.203033:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787602566.203038:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787602566.203045:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09dbc05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.203054:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09dbc05 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.203185:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602566.203254:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2351:x1874436833742592:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 333us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602566.203262:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 64 00010000:00010000:1.0:1787602566.204839:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09dbc05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602566.204854:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09dbc05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602566.204883:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09dbc05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602566.204888:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09dbc05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602566.204894:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09dbc05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602566.204899:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5e00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602566.204902:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09dbc05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602566.204908:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09dbc05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602566.204938:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09dbc05 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602566.204943:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf7f8982/0x3640686da09dbc05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602566.205066:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2353:x1874436833742336:12345-192.168.201.26@tcp:1:lfs.0 Request processed in 138576us (138852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602566.205072:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:2.0:1787602566.212095:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602566.212183:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833742848 00000100:00100000:3.0:1787602566.212194:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833742848 00000100:00100000:3.0:1787602566.212402:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 38 00000100:00100000:3.0:1787602566.212414:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3527f61850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+25:11374:x1874436833742848:12345-192.168.201.26@tcp:35:lfs.0 00000004:00010000:3.0:1787602566.212491:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbbf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25af expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787602566.212981:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1787602566.213027:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787602566.214054:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1787602566.214130:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbc0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.214151:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbb9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2585 expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.214161:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbc0c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.214204:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbb9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2585 expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.217470:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbb9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2585 expref: 29 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602566.217500:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d5af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1874436853673216:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787602566.217873:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602566.222000:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d5af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1874436853673216:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787602566.222038:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbc0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602566.224923:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602566.225089:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833742976 00000100:00100000:3.0:1787602566.225099:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833742976 00010000:00010000:3.0:1787602566.225145:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbb9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2585 expref: 30 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602566.225190:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00100000:3.0:1787602566.225200:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3509d57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+30:2352:x1874436833742976:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602566.225228:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602566.225236:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbb9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2585 expref: 30 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.225250:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbb9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2585 expref: 30 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.225299:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbb9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2585 expref: 30 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.225318:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81a00) 00010000:00010000:3.0:1787602566.225324:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbc0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.225333:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbc0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.225341:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbc0c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.225364:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602566.225439:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3509d57450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+29:2352:x1874436833742976:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 240us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602566.225447:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 65 00010000:00010000:0.0:1787602566.226249:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbc0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.226262:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbc0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787602566.226424:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787602566.226813:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1787602566.226976:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d5af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874436853673344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787602566.227047:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602566.227077:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787602566.227159:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853673344 00000100:00100000:2.0:1787602566.227168:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853673344 00000100:00100000:2.0:1787602566.227233:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787602566.227252:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874436853673344:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787602566.227346:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874436853673344:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 96us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602566.227353:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787602566.227409:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d5af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874436853673344:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787602566.227946:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787602566.228011:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3502f2c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874436853673472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787602566.228044:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602566.228065:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350c8326c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602566.228080:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853673472 00000100:00100000:2.0:1787602566.228085:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853673472 00000100:00100000:2.0:1787602566.228106:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787602566.228113:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874436853673472:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787602566.228317:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1874436853673472:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 204us (272us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787602566.228325:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787602566.228360:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3502f2c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874436853673472:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1787602566.231240:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1787602566.231430:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1787602566.231514:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbc0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.231526:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbc0c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.231533:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbc0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.231557:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602566.231562:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbc0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.231569:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbc0c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.231586:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81a00) 00010000:00010000:2.0:1787602566.231589:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787602566.231594:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbc0c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.231600:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbc0c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787602566.233119:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787602566.233535:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1787602566.233554:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351179809292ns, next at 352179805531ns, rc = 0 00000001:00080000:2.0:1787602566.233563:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787602566.233856:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81a00) 00010000:00010000:2.0:1787602566.233861:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787602566.233872:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbbf7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25af expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602566.234065:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3527f61850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+32:11374:x1874436833742848:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 21652us (21977us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787602566.234076:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 38 00000020:00080000:2.0:1787602566.234083:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787602566.242206:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602566.242310:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833743104 00000100:00100000:1.0:1787602566.242322:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833743104 00000100:00100000:1.0:1787602566.242396:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 148 00000100:00100000:1.0:1787602566.242407:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+32:11374:x1874436833743104:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787602566.242431:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602566.242456:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbc13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c25b6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602566.242524:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbc13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25b6 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602566.242539:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbc13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25b6 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602566.242560:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:1.0:1787602566.242564:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787602566.242581:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eaa00, rc 0) 00000100:00100000:1.0:1787602566.242871:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+33:11374:x1874436833743104:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 464us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602566.242879:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 148 00000100:00100000:2.0:1787602566.247257:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602566.247365:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833743360 00000100:00100000:0.0:1787602566.247377:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833743360 00000100:00100000:0.0:1787602566.247459:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:0.0:1787602566.247471:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+33:11374:x1874436833743360:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:0.0:1787602566.247780:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+34:11374:x1874436833743360:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 273us (497us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1787602566.247789:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 39 00000001:00080000:1.0:1787602566.341909:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967432 is committed 00000004:00080000:1.0:1787602566.342123:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787602566.342149:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d350c832840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787602566.342154:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d353d65a200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d350c832180 00000020:00080000:1.0:1787602566.342157:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d353d65ac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d35089a1800 00000020:00080000:0.0:1787602566.342196:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787602566.342993:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787602566.343253:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853673600:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787602566.343337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602566.343506:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853673600 00000100:00100000:1.0:1787602566.343513:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853673600 00000100:00100000:1.0:1787602566.343557:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787602566.343565:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874436853673600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787602566.343592:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1787602566.343638:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8ca686, atime: 0x6a8ca687, ctime: 0x6a8ca686, blocks: 0xb 00010000:00010000:1.0:1787602566.343647:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dbc1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602566.343666:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1787602566.343671:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602566.343679:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dbc1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602566.343692:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dbc1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602566.343703:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dbc1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602566.343717:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dbc1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602566.343736:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602566.344620:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602566.344631:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dbc1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.344643:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ebc00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602566.344647:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dbc1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.344658:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dbc1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.344678:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dbc1a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.344686:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dbc1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.344708:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602566.344710:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602566.344712:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602566.344964:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1874436853673600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1397us (1625us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787602566.344973:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000004:00080000:0.0:1787602566.345038:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d34074c9f80/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787602566.345044:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853673600:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787602566.364261:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602566.364383:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833743616 00000100:00100000:0.0:1787602566.364394:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833743616 00000100:00100000:0.0:1787602566.364460:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 149 00000100:00100000:0.0:1787602566.364472:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+16:11384:x1874436833743616:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602566.364501:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602566.364521:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbc21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c25bd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602566.364865:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787602566.365106:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbc21 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25bd expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.365121:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502900) 00010000:00010000:0.0:1787602566.365125:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602566.365131:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbc21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25bd expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602566.365144:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e3200, rc 0) 00000100:00100000:0.0:1787602566.365221:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+17:11384:x1874436833743616:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 750us (968us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787602566.365230:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 149 00000100:00100000:1.0:1787602566.372358:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602566.372473:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833743744 00000100:00100000:2.0:1787602566.372483:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833743744 00000100:00100000:2.0:1787602566.372542:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 150 00000100:00100000:2.0:1787602566.372553:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+17:11384:x1874436833743744:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:2.0:1787602566.372645:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc2f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.372674:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.372695:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.372712:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.372719:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.372726:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373119:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbc3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373129:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbc3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373137:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbc3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602566.373181:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbc3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373194:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373201:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc2f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373219:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373225:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602566.373229:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373237:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc2f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373247:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:2.0:1787602566.373250:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602566.373255:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373261:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373273:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373280:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373295:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373301:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602566.373305:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373322:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373331:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3504d95300) 00010000:00010000:2.0:1787602566.373333:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602566.373336:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373341:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373355:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbc3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373362:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbc3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373368:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbc3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373373:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602566.373375:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbc3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373381:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbc3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373388:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:2.0:1787602566.373391:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602566.373394:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbc3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.373411:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbc3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602566.373552:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+17:11384:x1874436833743744:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 998us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602566.373560:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 150 00000100:00100000:3.0:1787602566.377572:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602566.380428:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833744000 00000100:00100000:0.0:1787602566.380446:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833744000 00000100:00100000:1.0:1787602566.381063:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:1.0:1787602566.381076:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+17:11384:x1874436833744000:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787602566.382199:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+18:11384:x1874436833744000:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 1118us (4844us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1787602566.382210:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:3.0:1787602566.460853:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602566.462404:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833744256 00000100:00100000:0.0:1787602566.462421:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833744256 00000100:00100000:3.0:1787602566.462588:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 151 00000100:00100000:3.0:1787602566.462600:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+18:11387:x1874436833744256:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602566.462815:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602566.462835:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbc44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c25c4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.462901:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbc4b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.462926:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbc4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.462937:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbc4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.462954:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbc52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.462961:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbc52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.462967:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbc52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463355:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbc59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463371:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbc59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463377:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbc59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602566.463386:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787602566.463463:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbc4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463469:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbc4b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463475:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbc4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463487:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602566.463492:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbc4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463499:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbc4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463513:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:3.0:1787602566.463516:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602566.463522:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbc4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463528:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbc4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463541:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbc52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463545:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbc52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463549:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbc52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463551:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602566.463553:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbc52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463556:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbc52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463568:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3529dc7c00) 00010000:00010000:3.0:1787602566.463570:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602566.463572:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbc52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463576:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbc52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463856:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbc44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25c4 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463872:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbc59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25c4 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602566.463879:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:3.0:1787602566.463881:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602566.463884:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432600, rc 0) 00000100:00100000:3.0:1787602566.464010:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+20:11387:x1874436833744256:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1410us (3166us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1787602566.464018:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 151 00000100:00100000:3.0:1787602566.469076:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602566.470257:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833744384 00000100:00100000:2.0:1787602566.470275:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833744384 00000100:00100000:2.0:1787602566.470565:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 152 00000100:00100000:2.0:1787602566.470577:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+20:11387:x1874436833744384:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:2.0:1787602566.471005:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.471023:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.471034:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.471061:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.471068:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.471075:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.471082:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602566.471086:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.471109:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.471122:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:2.0:1787602566.471125:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787602566.471130:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.471135:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602566.471224:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+20:11387:x1874436833744384:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 648us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602566.471232:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 152 00000100:00100000:2.0:1787602566.481418:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602566.481506:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833744640 00000100:00100000:0.0:1787602566.481534:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833744640 00000100:00100000:0.0:1787602566.481598:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 41 00000100:00100000:0.0:1787602566.481613:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+20:11387:x1874436833744640:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:0.0:1787602566.481843:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+21:11387:x1874436833744640:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 236us (436us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787602566.481849:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 41 00010000:00010000:0.0:1787602566.829045:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602566.919555:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602566.919816:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833744896 00000100:00100000:2.0:1787602566.919828:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833744896 00000100:00100000:2.0:1787602566.919889:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 153 00000100:00100000:2.0:1787602566.919899:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+21:11418:x1874436833744896:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:2.0:1787602566.919923:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602566.919944:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c25cb expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.920049:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.920063:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.920102:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602566.920115:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787602566.920243:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25cb expref: 24 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.920263:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25cb expref: 23 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.920272:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:2.0:1787602566.920275:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602566.920290:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4c00, rc 0) 00000100:00100000:2.0:1787602566.920369:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+23:11418:x1874436833744896:12345-192.168.201.26@tcp:101:cat.0 Request processed in 471us (827us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787602566.920377:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 153 00000100:00100000:3.0:1787602566.928149:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602566.928203:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602566.928340:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833745024 00000100:00100000:0.0:1787602566.928346:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833745280 00000100:00100000:2.0:1787602566.928351:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833745024 00000100:00100000:0.0:1787602566.928362:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833745280 00000100:00100000:0.0:1787602566.928431:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 42 00000100:00100000:2.0:1787602566.928435:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:0.0:1787602566.928446:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+24:11418:x1874436833745280:12345-192.168.201.26@tcp:35:cat.0 00000100:00100000:2.0:1787602566.928449:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+24:2351:x1874436833745024:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602566.928468:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602566.928495:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25cb expref: 24 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602566.928515:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:2.0:1787602566.928520:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602566.928589:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+23:2351:x1874436833745024:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 145us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602566.928598:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:0.0:1787602566.928791:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+23:11418:x1874436833745280:12345-192.168.201.26@tcp:35:cat.0 Request processed in 347us (585us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787602566.928799:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 42 00000100:00100000:0.0:1787602567.016877:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602567.016987:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833745536 00000100:00100000:1.0:1787602567.016998:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833745536 00000100:00100000:1.0:1787602567.017082:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 154 00000100:00100000:1.0:1787602567.017094:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+23:11424:x1874436833745536:12345-192.168.201.26@tcp:101:dd.0 00010000:00010000:1.0:1787602567.017133:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602567.017136:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787602567.017169:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbbd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25a1 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787602567.017207:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787602567.017378:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:1.0:1787602567.017448:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602567.017479:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbc83 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c25d2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.017579:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dbc8a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.017592:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbc59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25c4 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.017600:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dbc8a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.017633:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbc59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25c4 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.017646:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbc59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25c4 expref: 23 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602567.017660:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853673728:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602567.017804:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787602567.020417:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853673728:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602567.020451:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dbc8a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602567.028584:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602567.033064:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833745664 00000100:00100000:3.0:1787602567.033091:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833745664 00010000:00010000:3.0:1787602567.033147:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbc59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25c4 expref: 24 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602567.033259:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 66 00000100:00100000:3.0:1787602567.033271:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+24:2351:x1874436833745664:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602567.033299:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602567.033307:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbc59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25c4 expref: 24 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602567.033321:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbc59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25c4 expref: 24 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602567.033343:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbc59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25c4 expref: 24 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602567.033371:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:3.0:1787602567.033377:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dbc8a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602567.033387:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dbc8a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602567.033395:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dbc8a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602567.033435:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602567.033501:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+23:2351:x1874436833745664:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 232us (4926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602567.033510:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 66 00010000:00010000:2.0:1787602567.034103:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dbc8a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.034116:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dbc8a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602567.034138:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787602567.034322:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbc83 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25d2 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.034343:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dbc8a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25d2 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.034363:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:2.0:1787602567.034366:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787602567.034369:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354ebe00, rc 0) 00000100:00100000:2.0:1787602567.034427:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+23:11424:x1874436833745536:12345-192.168.201.26@tcp:101:dd.0 Request processed in 17335us (17560us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787602567.034435:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 154 00000100:00100000:0.0:1787602567.047873:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602567.048117:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833745920 00000100:00100000:2.0:1787602567.048131:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833745920 00000100:00100000:2.0:1787602567.048199:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 155 00000100:00100000:2.0:1787602567.048212:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+23:11424:x1874436833745920:12345-192.168.201.26@tcp:36:dd.0 00010000:00010000:2.0:1787602567.048536:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.048575:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.048587:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602567.048649:0:8208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787602567.048674:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9ef5b2d reply state 000000002c90b9f0 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602567.048683:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787602567.048819:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+26:11424:x1874436833745920:12345-192.168.201.26@tcp:36:dd.0 Request processed in 608us (958us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787602567.048827:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 155 00000020:00080000:2.0:1787602567.048832:0:8208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787602567.051504:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.051523:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.051549:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.051555:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602567.051560:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.051567:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.051585:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:1.0:1787602567.051588:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602567.051592:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.051599:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbc98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602567.277822:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853673856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602567.277913:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602567.278294:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853673856 00000100:00100000:1.0:1787602567.278303:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853673856 00000100:00100000:1.0:1787602567.278386:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787602567.278396:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853673856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787602567.278436:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602567.278501:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853673856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602567.278508:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787602567.278707:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853673856:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787602567.278788:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602567.569048:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602567.569292:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833746048 00000100:00100000:2.0:1787602567.569304:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833746048 00000100:00100000:2.0:1787602567.569387:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 156 00000100:00100000:2.0:1787602567.569399:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+25:11438:x1874436833746048:12345-192.168.201.26@tcp:101:stat.0 00010000:00010000:2.0:1787602567.569426:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602567.569451:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c25d9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.569541:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbca6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.569559:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbca6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.569572:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbca6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.569604:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbcad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.569613:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbcad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.569619:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbcad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.570051:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbcb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.570064:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dbc8a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25d2 expref: 26 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.570072:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbcb4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.570109:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dbc8a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25d2 expref: 26 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.570123:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dbc8a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25d2 expref: 26 pid: 5836 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602567.570138:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874436853673984:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602567.570274:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af52300 going to sleep for 11 seconds 00000100:00100000:0.0:1787602567.577114:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602567.577214:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833746304 00000100:00100000:1.0:1787602567.577224:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833746304 00000100:00100000:1.0:1787602567.577302:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:1.0:1787602567.577328:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+27:6052:x1874436833746304:12345-192.168.201.26@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787602567.577733:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+28:6052:x1874436833746304:12345-192.168.201.26@tcp:35:ldlm_bl.0 Request processed in 406us (629us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1787602567.577787:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:2.0:1787602567.578507:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874436853673984:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602567.578537:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbcb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602567.583086:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602567.583307:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833746432 00000100:00100000:2.0:1787602567.583319:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833746432 00010000:00010000:2.0:1787602567.583367:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dbc8a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25d2 expref: 28 pid: 5836 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602567.583416:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 67 00000100:00100000:2.0:1787602567.583426:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+28:2352:x1874436833746432:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602567.583442:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602567.583450:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dbc8a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25d2 expref: 28 pid: 5836 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.583463:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dbc8a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25d2 expref: 28 pid: 5836 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.583486:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dbc8a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25d2 expref: 28 pid: 5836 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.583506:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:2.0:1787602567.583511:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbcb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.583521:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbcb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.583528:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbcb4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.583568:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602567.583647:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+27:2352:x1874436833746432:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 221us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602567.583655:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 67 00010000:00010000:1.0:1787602567.585137:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbcb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585152:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbcb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602567.585205:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787602567.585210:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602567.585252:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbcb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585279:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbcb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585291:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbca6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585297:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbca6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585304:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbca6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585309:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602567.585313:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbca6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585337:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbca6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585354:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:1.0:1787602567.585357:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602567.585360:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbca6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585366:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbca6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585381:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbcad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585387:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbcad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585392:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbcad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585397:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602567.585399:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbcad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585405:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbcad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585412:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3504d95300) 00010000:00010000:1.0:1787602567.585414:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602567.585417:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbcad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585432:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbcad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585480:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbc9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25d9 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585495:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbcb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25d9 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.585514:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:1.0:1787602567.585516:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602567.585519:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5e00, rc 0) 00000100:00100000:1.0:1787602567.585588:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+26:11438:x1874436833746048:12345-192.168.201.26@tcp:101:stat.0 Request processed in 16191us (16554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602567.585727:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 156 00000100:00100000:0.0:1787602567.759350:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602567.759561:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833746688 00000100:00100000:3.0:1787602567.759573:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833746688 00000100:00100000:3.0:1787602567.759661:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 157 00000100:00100000:3.0:1787602567.759673:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+26:11444:x1874436833746688:12345-192.168.201.26@tcp:36:truncate.0 00010000:00010000:3.0:1787602567.759736:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602567.759811:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbcb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25d9 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602567.759846:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:3.0:1787602567.759853:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602567.760112:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbcbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602567.760126:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbcbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602567.760135:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbcbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787602567.760188:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1787602567.760213:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096761436 reply state 000000009277dbdc transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbcbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602567.760498:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787602567.760710:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+28:11444:x1874436833746688:12345-192.168.201.26@tcp:36:truncate.0 Request processed in 1037us (1367us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1787602567.760718:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 157 00000020:00080000:3.0:1787602567.760722:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787602567.767332:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbcbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.767350:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbcbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.767359:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbcbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.767366:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602567.767372:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbcbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.767381:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbcbb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.767417:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:1.0:1787602567.767420:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602567.767424:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbcbb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.767430:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dbcbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602567.852991:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602567.937030:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602567.937324:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833746816 00000100:00100000:1.0:1787602567.937345:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833746816 00000100:00100000:1.0:1787602567.937414:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 158 00000100:00100000:1.0:1787602567.937424:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+27:11458:x1874436833746816:12345-192.168.201.26@tcp:101:stat.0 00010000:00010000:1.0:1787602567.937448:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602567.937469:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbcc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c25e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.937856:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbcc9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.937873:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbcc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.937885:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbcc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.937896:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.937900:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.937919:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938206:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbcd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938212:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbcd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938217:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbcd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602567.938249:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787602567.938252:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602567.938281:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbcd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938296:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbcd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938305:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbcc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938311:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbcc9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938317:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbcc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938322:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602567.938327:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbcc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938343:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbcc9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938358:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:1.0:1787602567.938360:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602567.938365:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbcc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938371:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbcc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938384:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938388:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938393:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938398:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602567.938400:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938405:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938411:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d350cd81500) 00010000:00010000:1.0:1787602567.938413:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602567.938415:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938430:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938463:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbcc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25e0 expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938475:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbcd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25e0 expref: 28 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602567.938482:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:1.0:1787602567.938484:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602567.938487:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eb200, rc 0) 00000100:00100000:1.0:1787602567.938559:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+28:11458:x1874436833746816:12345-192.168.201.26@tcp:101:stat.0 Request processed in 1135us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602567.938566:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 158 00000100:00100000:2.0:1787602568.044175:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602568.044297:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833747072 00000100:00100000:3.0:1787602568.044307:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833747072 00000100:00100000:3.0:1787602568.044384:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 159 00000100:00100000:3.0:1787602568.044392:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+28:11468:x1874436833747072:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602568.044413:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602568.044431:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbcde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c25e7 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602568.044658:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787602568.044881:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbcde lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25e7 expref: 30 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602568.044894:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502900) 00010000:00010000:3.0:1787602568.044897:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787602568.044900:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbcde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25e7 expref: 30 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602568.044910:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432e00, rc 0) 00000100:00100000:3.0:1787602568.044968:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+29:11468:x1874436833747072:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 577us (804us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1787602568.044973:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 159 00000100:00100000:0.0:1787602568.049038:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602568.049284:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833747328 00000100:00100000:1.0:1787602568.049295:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833747328 00000100:00100000:1.0:1787602568.049361:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:1.0:1787602568.049370:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3527f61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+29:11468:x1874436833747328:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787602568.049803:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3527f61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+30:11468:x1874436833747328:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 434us (772us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787602568.049809:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:0.0:1787602568.111511:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602568.111604:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833747584 00000100:00100000:1.0:1787602568.111615:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833747584 00000100:00100000:1.0:1787602568.111677:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 160 00000100:00100000:1.0:1787602568.111686:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d48bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+30:11474:x1874436833747584:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787602568.111725:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602568.111774:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbcec lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c25ee expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.111867:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcf3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.111878:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbcd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25e0 expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.111885:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcf3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.111913:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbcd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25e0 expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.111922:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbcd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25e0 expref: 31 pid: 5836 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602568.111934:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853674112:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602568.112022:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948540 going to sleep for 11 seconds 00000100:00100000:0.0:1787602568.115514:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602568.115692:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833747712 00000100:00100000:3.0:1787602568.115702:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833747712 00010000:00010000:3.0:1787602568.115772:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbcd7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25e0 expref: 32 pid: 5836 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602568.115816:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00100000:3.0:1787602568.115826:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d489f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+32:2351:x1874436833747712:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602568.115840:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602568.115860:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbcd7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25e0 expref: 32 pid: 5836 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602568.115873:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbcd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25e0 expref: 32 pid: 5836 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602568.115898:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:3.0:1787602568.115904:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcf3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602568.115915:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602568.115923:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcf3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602568.115944:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602568.116016:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d489f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+32:2351:x1874436833747712:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 190us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602568.116023:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 68 00010000:00010000:1.0:1787602568.116667:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbcd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25e0 expref: 31 pid: 5836 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602568.116691:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853674112:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602568.116716:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.116783:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.116791:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602568.116811:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787602568.116984:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbcec lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25ee expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.117001:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcf3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25ee expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.117010:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:1.0:1787602568.117013:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787602568.117015:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354ea400, rc 0) 00000100:00100000:1.0:1787602568.117054:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d48bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+31:11474:x1874436833747584:12345-192.168.201.26@tcp:101:bash.0 Request processed in 5367us (5553us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1787602568.117062:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 160 00000100:00100000:0.0:1787602568.120823:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602568.120938:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833747968 00000100:00100000:3.0:1787602568.120952:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833747968 00000100:00100000:3.0:1787602568.121027:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 161 00000100:00100000:3.0:1787602568.121039:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+31:11474:x1874436833747968:12345-192.168.201.26@tcp:36:bash.0 00010000:00010000:3.0:1787602568.121335:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbd01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602568.121352:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbd01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602568.121363:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbd01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787602568.121435:0:8208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1787602568.121461:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f455fb8 reply state 00000000c9a997cc transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbd01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602568.121472:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787602568.121776:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+34:11474:x1874436833747968:12345-192.168.201.26@tcp:36:bash.0 Request processed in 738us (962us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787602568.121785:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 161 00000020:00080000:3.0:1787602568.121790:0:8208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787602568.127777:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbd01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.127797:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbd01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.127805:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbd01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.127812:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602568.127834:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbd01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.127843:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbd01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.127861:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:1.0:1787602568.127864:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602568.127868:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbd01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.127876:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dbd01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602568.131177:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602568.131530:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833748096 00000100:00100000:2.0:1787602568.131543:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833748096 00000100:00100000:2.0:1787602568.131618:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 162 00000100:00100000:2.0:1787602568.131631:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+33:11474:x1874436833748096:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787602568.131660:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602568.131683:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbd08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c25f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602568.131820:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbd0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602568.131837:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcf3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25ee expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602568.131846:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbd0f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602568.131883:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcf3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25ee expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602568.131897:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcf3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25ee expref: 34 pid: 5836 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602568.131914:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874436853674240:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602568.132019:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af52300 going to sleep for 11 seconds 00000100:00100000:2.0:1787602568.136187:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602568.136471:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874436853674240:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602568.136499:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbd0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602568.136578:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833748224 00000100:00100000:0.0:1787602568.136595:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833748224 00010000:00010000:0.0:1787602568.136636:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcf3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25ee expref: 35 pid: 5836 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602568.136675:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 69 00000100:00100000:0.0:1787602568.136685:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+35:2352:x1874436833748224:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602568.136699:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602568.136705:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcf3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25ee expref: 35 pid: 5836 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.136718:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcf3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25ee expref: 35 pid: 5836 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.136738:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbcf3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25ee expref: 35 pid: 5836 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.136787:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:0.0:1787602568.136792:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbd0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.136802:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbd0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.136810:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbd0f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.136851:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602568.136904:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+34:2352:x1874436833748224:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 220us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602568.136911:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 69 00010000:00010000:1.0:1787602568.137487:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbd0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.137497:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbd0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602568.137544:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787602568.137549:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602568.137571:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbd0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.137603:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbd08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25f5 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.137636:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbd0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25f5 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.137645:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:1.0:1787602568.137648:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602568.137651:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5200, rc 0) 00000100:00100000:1.0:1787602568.137686:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+33:11474:x1874436833748096:12345-192.168.201.26@tcp:101:bash.0 Request processed in 6057us (6522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602568.137693:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 162 00000100:00100000:0.0:1787602568.143463:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602568.143559:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833748480 00000100:00100000:1.0:1787602568.143569:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833748480 00000100:00100000:1.0:1787602568.143729:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:1.0:1787602568.143774:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+33:11474:x1874436833748480:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:1.0:1787602568.144030:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+34:11474:x1874436833748480:12345-192.168.201.26@tcp:35:bash.0 Request processed in 290us (576us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787602568.144038:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:0.0:1787602568.243638:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602568.243737:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833748736 00000100:00100000:3.0:1787602568.243779:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833748736 00000100:00100000:3.0:1787602568.243831:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 163 00000100:00100000:3.0:1787602568.243843:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+34:11484:x1874436833748736:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602568.243867:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602568.243889:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbd16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c25fc expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602568.244149:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787602568.244463:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbd16 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25fc expref: 36 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602568.244477:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502900) 00010000:00010000:3.0:1787602568.244480:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787602568.244486:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbd16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25fc expref: 36 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602568.244500:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432400, rc 0) 00000100:00100000:3.0:1787602568.244603:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+35:11484:x1874436833748736:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 762us (975us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1787602568.244611:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 163 00000100:00100000:2.0:1787602568.248673:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602568.248801:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833748864 00000100:00100000:1.0:1787602568.248810:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833748864 00000100:00100000:1.0:1787602568.248862:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 164 00000100:00100000:1.0:1787602568.248871:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+35:11484:x1874436833748864:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:1.0:1787602568.248947:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbd24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.248963:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbd24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.248992:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbd24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249008:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbd2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249016:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbd2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249022:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbd2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249373:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249383:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249391:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602568.249432:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249443:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbd24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249450:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbd24 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249458:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbd24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249473:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eac00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602568.249478:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbd24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249485:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbd24 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249498:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:1.0:1787602568.249501:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602568.249506:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbd24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249513:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbd24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249527:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbd2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249533:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbd2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249539:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbd2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249545:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eb200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602568.249547:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbd2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249553:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbd2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249570:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d350cd81500) 00010000:00010000:1.0:1787602568.249572:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602568.249575:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbd2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249581:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbd2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249594:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249600:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249606:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249612:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602568.249615:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249621:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249629:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:1.0:1787602568.249632:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602568.249635:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.249641:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602568.249732:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+35:11484:x1874436833748864:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 860us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602568.249766:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 164 00000100:00100000:0.0:1787602568.253465:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602568.253602:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833749120 00000100:00100000:3.0:1787602568.253612:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833749120 00000100:00100000:3.0:1787602568.253674:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:3.0:1787602568.253685:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d48aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+35:11484:x1874436833749120:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:3.0:1787602568.254251:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d48aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+36:11484:x1874436833749120:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 566us (797us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787602568.254269:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:3.0:1787602568.307598:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602568.307715:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833749376 00000100:00100000:0.0:1787602568.307726:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833749376 00000100:00100000:0.0:1787602568.307824:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 165 00000100:00100000:0.0:1787602568.307837:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+36:11487:x1874436833749376:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602568.307867:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602568.307890:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2200/0x3640686da09dbd39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2603 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.307967:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbd40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.307981:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbd40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.307991:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbd40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308005:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbd47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308012:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbd47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308034:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbd47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308463:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbd4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308473:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbd4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308482:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbd4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602568.308492:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787602568.308589:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbd40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308598:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbd40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308605:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbd40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308612:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602568.308617:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbd40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308625:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbd40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308638:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:0.0:1787602568.308642:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602568.308655:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbd40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308662:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbd40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308678:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbd47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308683:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbd47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308688:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbd47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308693:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602568.308696:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbd47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308702:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbd47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308710:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d350b502e00) 00010000:00010000:0.0:1787602568.308712:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602568.308715:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbd47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308721:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbd47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308807:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2200/0x3640686da09dbd39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2603 expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308837:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbd4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2603 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.308845:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:0.0:1787602568.308847:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787602568.308850:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2000, rc 0) 00000100:00100000:0.0:1787602568.309047:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+38:11487:x1874436833749376:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1212us (1468us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787602568.309056:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 165 00000100:00100000:2.0:1787602568.316972:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602568.317043:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833749504 00000100:00100000:1.0:1787602568.317054:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833749504 00000100:00100000:1.0:1787602568.317115:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 166 00000100:00100000:1.0:1787602568.317127:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+38:11487:x1874436833749504:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:1.0:1787602568.317201:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.317231:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.317245:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.317283:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.317292:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.317300:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.317307:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602568.317311:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.317319:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.317358:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:1.0:1787602568.317362:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602568.317368:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.317375:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602568.317459:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+38:11487:x1874436833749504:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 334us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602568.317468:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 166 00000100:00100000:2.0:1787602568.325251:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602568.325305:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602568.325412:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833749760 00000100:00100000:1.0:1787602568.325424:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833749760 00000100:00100000:1.0:1787602568.325479:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:1.0:1787602568.325491:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+38:11487:x1874436833749760:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787602568.325782:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+39:11487:x1874436833749760:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 292us (541us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787602568.325789:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:2.0:1787602568.326273:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833749888 00000100:00100000:2.0:1787602568.326280:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833749888 00000100:00100000:2.0:1787602568.326336:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:2.0:1787602568.326345:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+39:2352:x1874436833749888:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602568.326359:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602568.326386:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbd4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2603 expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602568.326408:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:2.0:1787602568.326413:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602568.327249:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+38:2352:x1874436833749888:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 900us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602568.327267:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:0.0:1787602568.542262:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602568.542370:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833750144 00000100:00100000:1.0:1787602568.542381:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833750144 00000100:00100000:1.0:1787602568.542448:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 167 00000100:00100000:1.0:1787602568.542460:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+38:11505:x1874436833750144:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:1.0:1787602568.542488:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602568.542511:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c260a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.542634:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbd6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.542664:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbd6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.542678:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbd6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602568.542690:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787602568.542855:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbd63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c260a expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.542876:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbd6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c260a expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.542885:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:1.0:1787602568.542888:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787602568.542892:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eac00, rc 0) 00000100:00100000:1.0:1787602568.542958:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+40:11505:x1874436833750144:12345-192.168.201.26@tcp:101:cat.0 Request processed in 501us (718us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787602568.542966:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 167 00000100:00100000:1.0:1787602568.610174:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602568.610456:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833750272 00000100:00100000:2.0:1787602568.610469:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833750272 00000100:00100000:2.0:1787602568.610535:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 168 00000100:00100000:2.0:1787602568.610548:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+40:11506:x1874436833750272:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787602568.610647:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602568.610732:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbd78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2611 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602568.610864:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbd7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602568.610879:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbd7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602568.610890:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbd7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602568.611082:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787602568.611087:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602568.611165:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbd7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602568.611200:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbd78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2611 expref: 42 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602568.611567:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbd7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2611 expref: 41 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602568.611653:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:2.0:1787602568.612497:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787602568.612504:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4600, rc 0) 00000100:00100000:2.0:1787602568.612603:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+41:11506:x1874436833750272:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 2054us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602568.612611:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 168 00000100:00100000:0.0:1787602568.624848:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602568.625001:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833750656 00000100:00100000:1.0:1787602568.625012:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833750656 00000100:00100000:1.0:1787602568.625078:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:1.0:1787602568.625090:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+41:11506:x1874436833750656:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787602568.625777:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+42:11506:x1874436833750656:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 651us (900us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1787602568.625788:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:1.0:1787602568.635727:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602568.635983:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833750784 00000100:00100000:0.0:1787602568.635997:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833750784 00000100:00100000:0.0:1787602568.636078:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:0.0:1787602568.636090:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3509d54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+42:11506:x1874436833750784:12345-192.168.201.26@tcp:103:lfs.0 00010000:00010000:0.0:1787602568.636107:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787602568.636135:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbd0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25f5 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.636161:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbd6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c260a expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.636179:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbc13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c25b6 expref: 40 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602568.636211:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81600) 00010000:00010000:0.0:1787602568.636223:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602568.636306:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3509d54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+39:11506:x1874436833750784:12345-192.168.201.26@tcp:103:lfs.0 Request processed in 218us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602568.636314:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:3.0:1787602568.638706:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602568.639430:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833750912 00000100:00100000:1.0:1787602568.639444:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833750912 00000100:00100000:1.0:1787602568.639508:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 169 00000100:00100000:1.0:1787602568.639520:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+39:11506:x1874436833750912:12345-192.168.201.26@tcp:58:lfs.0 00010000:00010000:1.0:1787602568.639720:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dbd86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.639739:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dbd86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.639842:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dbd86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787602568.640187:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1787602568.640291:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+39:11506:x1874436833750912:12345-192.168.201.26@tcp:58:lfs.0 Request processed in 771us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602568.640301:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 169 00000100:00100000:2.0:1787602568.700706:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602568.701002:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833751040 00000100:00100000:1.0:1787602568.701012:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833751040 00000100:00100000:1.0:1787602568.701077:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 170 00000100:00100000:1.0:1787602568.701089:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+39:11508:x1874436833751040:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787602568.701119:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602568.701141:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09dbd8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2618 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.701209:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbd94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.701306:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbd94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.701403:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbd94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.701421:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbd9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.701429:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbd9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.701435:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbd9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.702901:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbda2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.702917:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbda2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.702928:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbda2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602568.702973:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787602568.702978:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602568.702999:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbda2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.703012:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbda2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.703021:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbd94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.703040:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbd94 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.703048:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbd94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.703054:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602568.703059:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbd94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.703066:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbd94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.703080:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:1.0:1787602568.703083:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602568.703088:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbd94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.703095:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea600/0x3640686da09dbd94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.703126:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbd9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.703133:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbd9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.703140:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbd9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.703145:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eb600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602568.703154:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbd9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.703161:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbd9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.703170:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d350cd81f00) 00010000:00010000:1.0:1787602568.703173:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602568.703176:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbd9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.703182:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbd9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.705258:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea800/0x3640686da09dbd8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2618 expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.705291:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbda2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2618 expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602568.705301:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81500) 00010000:00010000:1.0:1787602568.705304:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602568.705307:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eaa00, rc 0) 00000100:00100000:1.0:1787602568.706879:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+40:11508:x1874436833751040:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 5783us (6173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602568.706890:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 170 00010000:00010000:3.0:1787602568.876908:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787602569.453991:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787602569.454011:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787602569.454054:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787602569.454062:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787602569.454209:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534976a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874436853674368:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787602569.454327:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3507937180 going to sleep for 11 seconds 00000100:00100000:3.0:1787602569.458422:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534976a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874436853674368:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787602569.459145:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602569.462489:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833751168 00000100:00100000:2.0:1787602569.462505:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833751168 00000100:00100000:2.0:1787602569.463341:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 171 00000100:00100000:2.0:1787602569.463357:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+40:11519:x1874436833751168:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787602569.463393:0:8208:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787602569.463516:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+40:11519:x1874436833751168:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 164us (4372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602569.463523:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 171 00000100:00080000:0.0:1787602569.463604:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602569.481828:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602569.481920:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833751296 00000100:00100000:2.0:1787602569.481933:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833751296 00000100:00100000:2.0:1787602569.482004:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 172 00000100:00100000:2.0:1787602569.482016:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+40:11519:x1874436833751296:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787602569.482100:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbda9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482119:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbda9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482134:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbda9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482197:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbdb0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482224:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbdb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482232:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbdb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482274:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbdb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482284:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbdb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482291:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbdb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602569.482535:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787602569.482541:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602569.482554:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbdb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482565:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbda9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482572:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbda9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482579:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbda9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482585:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602569.482590:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbda9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482604:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbda9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482617:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d350b502400) 00010000:00010000:2.0:1787602569.482620:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602569.482625:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbda9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482631:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbda9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482645:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbdb0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482651:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbdb0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482657:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbdb0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482662:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602569.482665:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbdb0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482670:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbdb0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482677:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8d3504d95500) 00010000:00010000:2.0:1787602569.482679:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602569.482682:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbdb0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482698:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbdb0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482714:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbdb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482719:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbdb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482725:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbdb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482730:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602569.482733:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbdb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482739:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbdb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482801:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81500) 00010000:00010000:2.0:1787602569.482803:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602569.482807:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbdb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.482812:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbdb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602569.482892:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+40:11519:x1874436833751296:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 Request processed in 876us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602569.482900:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 172 00000100:00100000:1.0:1787602569.495487:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602569.495581:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833751552 00000100:00100000:2.0:1787602569.495594:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833751552 00000100:00100000:2.0:1787602569.495660:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 173 00000100:00100000:2.0:1787602569.495671:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+40:11519:x1874436833751552:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602569.495691:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602569.495712:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbdbe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c261f expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.495862:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbdc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.495881:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.495893:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602569.495906:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787602569.496019:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.496028:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbdc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.496036:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbdc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.496042:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602569.496047:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbdc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.496054:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbdc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.496086:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81500) 00010000:00010000:2.0:1787602569.496089:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787602569.496095:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbdc5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.496102:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbdc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.496150:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbdbe lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c261f expref: 42 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.496161:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d350b502400) 00010000:00010000:2.0:1787602569.496164:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787602569.496169:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbdbe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c261f expref: 42 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.496180:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4c00, rc 0) 00000100:00100000:2.0:1787602569.497242:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+41:11519:x1874436833751552:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 636us (929us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1787602569.497257:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 173 00000100:00100000:1.0:1787602569.506557:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602569.516458:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833751680 00000100:00100000:2.0:1787602569.516475:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833751680 00000100:00100000:2.0:1787602569.516546:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 174 00000100:00100000:2.0:1787602569.516558:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+41:11519:x1874436833751680:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787602569.516594:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787602569.516737:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+41:11519:x1874436833751680:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 181us (10191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602569.516786:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 174 00000100:00100000:3.0:1787602569.520063:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602569.521559:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833751936 00000100:00100000:1.0:1787602569.521575:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833751936 00000100:00100000:1.0:1787602569.521658:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 175 00000100:00100000:1.0:1787602569.521669:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+41:11519:x1874436833751936:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602569.521690:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602569.521693:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787602569.521721:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbd7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2611 expref: 41 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.521978:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:1.0:1787602569.521984:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602569.522001:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbdd3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2626 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787602569.524164:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787602569.527808:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbdda lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.527836:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbdda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.527851:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbdda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.527942:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbdd3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2626 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.527963:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbdda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2626 expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.527972:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d350cd81f00) 00010000:00010000:1.0:1787602569.527984:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602569.527988:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354ea000, rc 0) 00000100:00100000:1.0:1787602569.528080:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+42:11519:x1874436833751936:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 6413us (8026us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1787602569.528090:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 175 00000100:00100000:1.0:1787602569.556665:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602569.556792:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833752192 00000100:00100000:0.0:1787602569.556807:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833752192 00000100:00100000:0.0:1787602569.556896:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 176 00000100:00100000:0.0:1787602569.556909:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+42:11519:x1874436833752192:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787602569.557003:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602569.557040:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbdda lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2626 expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.557071:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d350cd81f00) 00010000:00010000:0.0:1787602569.557086:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602569.557123:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09dbde8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.557140:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09dbde8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.557152:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09dbde8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.557214:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbdef lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc06fa6cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.557246:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbdef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc06fa6cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.557254:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbdef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc06fa6cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.564838:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09dbde8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.564858:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09dbde8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.564866:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09dbde8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.564872:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602569.564877:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09dbde8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.564885:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09dbde8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.564903:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:0.0:1787602569.564907:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602569.564912:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09dbde8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.564918:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3c00/0x3640686da09dbde8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.564933:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbdef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc06fa6cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.564947:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbdef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc06fa6cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.564952:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbdef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc06fa6cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.564957:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602569.564960:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbdef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc06fa6cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.564966:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbdef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc06fa6cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.564973:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc06fa6cd (ffff8d350b502000) 00010000:00010000:0.0:1787602569.564975:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602569.564978:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbdef lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc06fa6cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.564983:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dbdef lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc06fa6cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602569.565098:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+41:11519:x1874436833752192:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 8186us (8441us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787602569.565107:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 176 00000100:00100000:0.0:1787602569.571850:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602569.571899:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833752320 00000100:00100000:0.0:1787602569.571911:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833752320 00000100:00100000:0.0:1787602569.571968:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 177 00000100:00100000:0.0:1787602569.571980:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+41:11519:x1874436833752320:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602569.572015:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602569.572043:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbdf6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c262d expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.572081:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbdfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.572096:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbdfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.572108:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbdfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.572208:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbdf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c262d expref: 43 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.572226:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbdfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c262d expref: 42 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.572248:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d350b502c00) 00010000:00010000:0.0:1787602569.572251:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787602569.572255:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2000, rc 0) 00000100:00100000:0.0:1787602569.572438:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+42:11519:x1874436833752320:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 458us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602569.572445:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 177 00000100:00100000:3.0:1787602569.583719:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602569.584440:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833752576 00000100:00100000:1.0:1787602569.584452:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833752576 00000100:00100000:1.0:1787602569.584520:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 178 00000100:00100000:1.0:1787602569.584533:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+42:11519:x1874436833752576:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787602569.584646:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbe04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.584667:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbe04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.584681:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbe04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787602569.585121:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1787602569.585132:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354531388597ns, next at 355531386428ns, rc = 0 00000004:00010000:1.0:1787602569.585213:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004510aa1c reply state 000000009d642a9a transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbe04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602569.585223:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787602569.585355:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+44:11519:x1874436833752576:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 824us (1645us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787602569.585362:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 178 00010000:00010000:1.0:1787602569.587600:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbe04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.587624:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbe04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.587632:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbe04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.587638:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eac00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602569.587644:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbe04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.587652:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbe04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.587670:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d350b502c00) 00010000:00010000:1.0:1787602569.587673:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787602569.587678:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbe04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.587685:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbe04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602569.591263:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602569.596126:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833752704 00000100:00100000:3.0:1787602569.596145:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833752704 00000100:00100000:3.0:1787602569.599418:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 179 00000100:00100000:3.0:1787602569.599446:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+43:11519:x1874436833752704:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602569.599476:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602569.599503:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbe0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2634 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602569.599600:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbe0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2634 expref: 44 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602569.599617:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbe0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2634 expref: 44 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602569.599702:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d350b502c00) 00010000:00010000:3.0:1787602569.599706:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602569.599710:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432400, rc 0) 00000100:00100000:3.0:1787602569.599875:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+44:11519:x1874436833752704:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 440us (8640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602569.599883:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 179 00000100:00100000:3.0:1787602569.610206:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602569.610345:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833752832 00000100:00100000:0.0:1787602569.610360:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833752832 00000100:00100000:0.0:1787602569.610454:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:0.0:1787602569.610466:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2351:x1874436833752832:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787602569.611129:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833752832:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 661us (935us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787602569.611142:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00080000:3.0:1787602569.611447:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787602569.620402:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602569.622675:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833753088 00000100:00100000:2.0:1787602569.622696:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833753088 00000100:00100000:3.0:1787602569.628197:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:3.0:1787602569.628218:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+44:11519:x1874436833753088:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787602569.630277:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+45:11519:x1874436833753088:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 2048us (9877us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787602569.630296:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:2.0:1787602569.640432:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602569.640824:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833753344 00000100:00100000:1.0:1787602569.640837:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833753344 00000100:00100000:1.0:1787602569.640907:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 180 00000100:00100000:1.0:1787602569.640924:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+45:11519:x1874436833753344:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787602569.641052:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+45:11519:x1874436833753344:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 135us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602569.641061:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 180 00000100:00100000:0.0:1787602569.649954:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602569.650043:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833753472 00000100:00100000:1.0:1787602569.650061:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833753472 00000100:00100000:1.0:1787602569.650160:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 181 00000100:00100000:1.0:1787602569.650178:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+45:11519:x1874436833753472:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602569.650201:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602569.650226:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbe12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c263b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.650322:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbe19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.650341:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbe19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.650352:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbe19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602569.650401:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602569.650426:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbe19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.650458:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbe12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c263b expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.650480:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbe19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c263b expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.650489:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d350b502c00) 00010000:00010000:1.0:1787602569.650492:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787602569.650497:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354ea400, rc 0) 00000100:00100000:1.0:1787602569.650616:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+46:11519:x1874436833753472:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 443us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602569.650623:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 181 00000100:00100000:3.0:1787602569.661937:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602569.662013:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833753600 00000100:00100000:2.0:1787602569.662030:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833753600 00000100:00100000:2.0:1787602569.663569:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 54 00000100:00100000:2.0:1787602569.663594:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2352:x1874436833753600:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602569.663621:0:8625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602569.663647:0:8625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dbe20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2642 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787602569.663679:0:8625:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8ca68a, blocks: 0x1 00010000:00010000:2.0:1787602569.663703:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1787602569.663708:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602569.663718:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dbe20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2642 expref: 8 pid: 8625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.663772:0:8625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dbe20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2642 expref: 8 pid: 8625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.663788:0:8625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4e00, rc 0) 00000100:00100000:2.0:1787602569.663886:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2352:x1874436833753600:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 303us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602569.663896:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 54 00000100:00100000:2.0:1787602569.691573:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602569.691658:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833753856 00000100:00100000:0.0:1787602569.691673:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833753856 00000100:00100000:0.0:1787602569.691772:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 182 00000100:00100000:0.0:1787602569.691786:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+46:11519:x1874436833753856:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787602569.691937:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+46:11519:x1874436833753856:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 154us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602569.691947:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 182 00000100:00100000:2.0:1787602569.695480:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602569.695802:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833753984 00000100:00100000:0.0:1787602569.695819:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833753984 00000100:00100000:0.0:1787602569.695904:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00100000:0.0:1787602569.695917:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+8:11519:x1874436833753984:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602569.695943:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602569.695970:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa07744c/0x3640686da09dbe27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2649 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.696021:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dbe20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2642 expref: 9 pid: 8625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.696033:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602569.696038:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602569.696044:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa07744c/0x3640686da09dbe27 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2649 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.696101:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dbe20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2642 expref: 9 pid: 8625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.696419:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dbe20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2642 expref: 9 pid: 8625 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602569.696439:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35357e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6689:1874436853674496:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787602569.696571:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32480 going to sleep for 11 seconds 00000100:00100000:0.0:1787602569.708146:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602569.708249:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833754112 00000100:00100000:1.0:1787602569.708263:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833754112 00010000:00010000:1.0:1787602569.708329:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dbe20 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2642 expref: 10 pid: 8625 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602569.708382:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 70 00000100:00100000:1.0:1787602569.708394:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+10:2352:x1874436833754112:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602569.708415:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602569.708446:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dbe20 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2642 expref: 10 pid: 8625 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.708463:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dbe20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2642 expref: 10 pid: 8625 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.708493:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602569.708499:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602569.708510:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa07744c/0x3640686da09dbe27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2649 expref: 10 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.708522:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa07744c/0x3640686da09dbe27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2649 expref: 10 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.708569:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000aa07744c/0x3640686da09dbe27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2649 expref: 10 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602569.708593:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1874436853674624:192.168.201.26@tcp:105: 00000100:00100000:1.0:1787602569.708704:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948780 going to sleep for 11 seconds 00010000:00010000:2.0:1787602569.709922:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d8dae70/0x3640686da09dbe20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2642 expref: 10 pid: 8625 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602569.709941:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35357e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6689:1874436853674496:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602569.709974:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa07744c/0x3640686da09dbe27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2649 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.709990:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e3c00, rc 0) 00000100:00100000:2.0:1787602569.710157:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+9:11519:x1874436833753984:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 14240us (14689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602569.710166:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00100000:2.0:1787602569.711410:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1874436853674624:192.168.201.26@tcp:105: 00010000:00010000:2.0:1787602569.711440:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602569.711498:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2352:x1874436833754112:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 3105us (3362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602569.711509:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 70 00000100:00100000:0.0:1787602569.716441:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602569.716521:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833754240 00000100:00100000:3.0:1787602569.716534:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833754240 00002000:00100000:3.0:1787602569.716609:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d35357ead80 x1874436833754240/t0(0) o4->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:405/0 lens 504/0 e 0 to 0 dl 1787602580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787602569.716636:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d35357ead80 with x1874436833754240 ext(0->8) 00002000:00010000:3.0:1787602569.716643:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d35357ead80 00000100:00100000:3.0:1787602569.716685:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:3.0:1787602569.716698:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2351:x1874436833754240:12345-192.168.201.26@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787602569.717457:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+10:2351:x1874436833754240:12345-192.168.201.26@tcp:4:lhsmtool_posix.0 Request processed in 757us (1027us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787602569.717468:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 4 00002000:00100000:3.0:1787602569.717476:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d35357ead80 x1874436833754240/t4294967314(0) o4->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:405/0 lens 504/448 e 0 to 0 dl 1787602580 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787602569.717485:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d35357ead80 with x1874436833754240 ext(0->8) 00002000:00010000:3.0:1787602569.717489:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d35357ead80 00000100:00100000:2.0:1787602569.739186:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602569.739445:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833754368 00000100:00100000:3.0:1787602569.739460:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833754368 00000100:00100000:3.0:1787602569.739534:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 183 00000100:00100000:3.0:1787602569.739547:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+46:11519:x1874436833754368:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 00000040:00080000:0.0:1787602569.743159:0:12504:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787602569.743172:0:12504:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787602569.743423:0:12504:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787602569.743431:0:12504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787602569.801876:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+46:11519:x1874436833754368:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 Request processed in 62314us (62689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602569.801892:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 183 00000001:00080000:3.0:1787602569.801946:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000020:00080000:3.0:1787602569.801966:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1787602569.801982:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1787602569.801987:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:3.0:1787602569.802056:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1787602569.802557:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787602569.802595:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787602569.802785:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602569.802810:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853674752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787602569.802885:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602569.803843:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853674752 00000100:00100000:2.0:1787602569.803857:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853674752 00000100:00100000:2.0:1787602569.803942:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787602569.803954:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853674752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787602569.804714:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787602569.804722:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787602570 00002000:00010000:2.0:1787602569.804725:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787602569.804728:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787602570 -> 1787602570 00002000:00010000:2.0:1787602569.804799:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787602569.804895:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1874436853674752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 942us (2007us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787602569.804906:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00080000:1.0:1787602569.805044:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d3503e4c700/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787602569.805053:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853674752:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1787602569.806530:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602569.806813:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602569.807052:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833754496 00000100:00100000:2.0:1787602569.807066:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833754496 00000100:00100000:2.0:1787602569.807134:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:2.0:1787602569.807148:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+10:2352:x1874436833754496:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787602569.840683:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35357e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853675264:0@lo:400:kworker.0 00000100:00100000:0.0:1787602569.841447:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35357e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853674880:0@lo:400:kworker.0 00000100:00100000:2.0:1787602569.841641:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602569.841762:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787602569.841773:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35357eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853675136:0@lo:400:kworker.0 00000100:00100000:2.0:1787602569.841809:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602569.841856:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853675264 00000100:00100000:2.0:1787602569.841866:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853675264 00000100:00100000:2.0:1787602569.841944:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853675136 00000100:00100000:2.0:1787602569.841948:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853675136 00000100:00100000:2.0:1787602569.841979:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787602569.841992:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853675264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602569.842063:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853675264:12345-0@lo:400:kworker.0 Request processed in 73us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602569.842072:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787602569.842097:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787602569.842104:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853675136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602569.842135:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853675136:12345-0@lo:400:kworker.0 Request processed in 31us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602569.842163:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1787602569.842184:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602569.842239:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35357eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853675136:0@lo:400:kworker.0 00000100:00100000:2.0:1787602569.842254:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35357e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853675264:0@lo:400:kworker.0 00000100:00100000:0.0:1787602569.842686:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602569.842737:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35357eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853675392:0@lo:400:kworker.0 00000100:00100000:0.0:1787602569.842790:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602569.842823:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787602569.842830:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35357e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853675008:0@lo:400:kworker.0 00000100:00100000:0.0:1787602569.842855:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602569.843813:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853675008 00000100:00100000:1.0:1787602569.843826:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853675008 00000100:00100000:1.0:1787602569.843886:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787602569.843897:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853675008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602569.843984:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853675008:12345-0@lo:400:kworker.0 Request processed in 90us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602569.843992:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787602569.844250:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853674880 00000100:00100000:3.0:1787602569.844256:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853674880 00000100:00100000:3.0:1787602569.844287:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787602569.844296:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853674880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602569.844351:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853674880:12345-0@lo:400:kworker.0 Request processed in 56us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602569.844358:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787602569.844813:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853675392 00000100:00100000:2.0:1787602569.844820:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853675392 00000100:00100000:2.0:1787602569.845027:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787602569.845037:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1874436853675392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602569.845089:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1874436853675392:12345-0@lo:400:kworker.0 Request processed in 55us (2298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602569.845097:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1787602569.845200:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787602569.846880:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35357e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853675008:0@lo:400:kworker.0 00000100:00100000:1.0:1787602569.846900:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35357e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853674880:0@lo:400:kworker.0 00000100:00100000:1.0:1787602569.846916:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35357eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853675392:0@lo:400:kworker.0 00000001:00080000:1.0:1787602569.878992:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1787602569.879056:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:2.0:1787602569.879315:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:2.0:1787602569.879477:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2352:x1874436833754496:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 Request processed in 72323us (72661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602569.879491:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:3.0:1787602569.886802:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602569.890203:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833754752 00000100:00100000:2.0:1787602569.890236:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833754752 00000100:00100000:2.0:1787602569.890334:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 184 00000100:00100000:2.0:1787602569.890349:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+18:11519:x1874436833754752:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787602569.890437:0:8208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602569.890476:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea400/0x3640686da09dbe19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c263b expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.890501:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d350b502c00) 00010000:00010000:2.0:1787602569.890508:0:8208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787602569.890566:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbe2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.890585:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbe2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.890599:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbe2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602569.891004:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2956c80 reply state 000000003fbb0088 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbe2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602569.891017:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787602569.891174:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+19:11519:x1874436833754752:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 826us (4386us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787602569.891182:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 184 00000100:00100000:2.0:1787602569.896118:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00010000:00010000:0.0:1787602569.896305:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbe2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.896337:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbe2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.896346:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbe2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.896354:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602569.896360:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbe2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602569.896367:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833754880 00010000:00010000:0.0:1787602569.896368:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbe2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602569.896382:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833754880 00010000:00010000:0.0:1787602569.896390:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d350b502c00) 00010000:00010000:0.0:1787602569.896393:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602569.896398:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbe2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.896404:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbe2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602569.896468:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 58 00000100:00100000:3.0:1787602569.896480:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833754880:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787602569.896973:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787602569.896978:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787602570 -> 1787602569 00002000:00010000:3.0:1787602569.896981:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787602567 00002000:00010000:3.0:1787602569.896983:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787602570 -> 1787602569 00002000:00010000:3.0:1787602569.896985:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787602569.897079:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2351:x1874436833754880:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 600us (974us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787602569.897087:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 58 00010000:00010000:2.0:1787602569.902455:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602569.911722:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602569.912424:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833755136 00000100:00100000:1.0:1787602569.912440:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833755136 00000100:00100000:1.0:1787602569.912522:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 185 00000100:00100000:1.0:1787602569.912535:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+18:11519:x1874436833755136:12345-192.168.201.26@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787602569.912631:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbe35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.912666:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbdfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c262d expref: 18 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.912678:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbe35 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.912726:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbdfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c262d expref: 18 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.912759:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbdfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c262d expref: 18 pid: 8208 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602569.912777:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853675520:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602569.912901:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948780 going to sleep for 11 seconds 00000100:00100000:0.0:1787602569.927167:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602569.927270:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833755264 00000100:00100000:3.0:1787602569.927285:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833755264 00000100:00100000:1.0:1787602569.927326:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853675520:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602569.927356:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbdfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c262d expref: 19 pid: 8208 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.927361:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbe35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602569.927410:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 71 00000100:00100000:3.0:1787602569.927423:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+19:2352:x1874436833755264:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602569.927442:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602569.927514:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbdfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c262d expref: 19 pid: 8208 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602569.927531:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbdfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c262d expref: 19 pid: 8208 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602569.927561:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbdfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c262d expref: 19 pid: 8208 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602569.927709:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d350b502c00) 00010000:00010000:3.0:1787602569.927716:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbe35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602569.927728:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbe35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602569.927736:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbe35 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602569.927797:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602569.927856:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbe35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602569.927863:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+18:2352:x1874436833755264:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 443us (714us total) trans 0 rc 0/0 00010000:00010000:1.0:1787602569.927865:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbe35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602569.927892:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 71 00010000:00010000:1.0:1787602569.927903:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbe35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.927910:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbe35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.927924:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbe35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.927930:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eae00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602569.927935:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbe35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.927943:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbe35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.927953:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d350b502c00) 00010000:00010000:1.0:1787602569.927956:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787602569.927959:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbe35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602569.927965:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dbe35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602569.928009:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+17:11519:x1874436833755136:12345-192.168.201.26@tcp:55:lhsmtool_posix.0 Request processed in 15477us (16444us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787602569.928132:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 185 00000100:00100000:3.0:1787602569.933300:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602569.936813:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833755392 00000100:00100000:2.0:1787602569.936835:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833755392 00000100:00100000:2.0:1787602569.936973:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:2.0:1787602569.936987:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2351:x1874436833755392:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787602569.937051:0:8625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dbe3c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.937145:0:8625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa07744c/0x3640686da09dbe27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2649 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.937157:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602569.937162:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602569.937175:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dbe3c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.937223:0:8625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa07744c/0x3640686da09dbe27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2649 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.937253:0:8625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa07744c/0x3640686da09dbe27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2649 expref: 8 pid: 6689 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602569.937274:0:8625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1874436853675648:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602569.937481:0:8625:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a0f0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787602569.959175:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602569.959261:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833755520 00000100:00100000:0.0:1787602569.959275:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833755520 00010000:00010000:0.0:1787602569.959340:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa07744c/0x3640686da09dbe27 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2649 expref: 9 pid: 6689 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602569.959392:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 72 00000100:00100000:0.0:1787602569.959405:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+9:2352:x1874436833755520:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602569.959443:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602569.959783:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa07744c/0x3640686da09dbe27 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2649 expref: 9 pid: 6689 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.959804:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa07744c/0x3640686da09dbe27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2649 expref: 9 pid: 6689 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.959841:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602569.959847:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602569.959854:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dbe3c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.959867:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dbe3c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602569.959900:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602569.959979:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+9:2352:x1874436833755520:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 575us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602569.959989:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 72 00010000:00010000:2.0:1787602569.961706:0:8625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa07744c/0x3640686da09dbe27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2649 expref: 8 pid: 6689 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602569.961799:0:8625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1874436853675648:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602569.961833:0:8625:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dbe3c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.961846:0:8625:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dbe3c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.961854:0:8625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dbe3c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.961899:0:8625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dbe3c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.961934:0:8625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dbe3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.961945:0:8625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dbe3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.961952:0:8625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4a00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602569.961958:0:8625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dbe3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.961969:0:8625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dbe3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.961991:0:8625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dbe3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.962000:0:8625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dbe3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602569.963489:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833755392:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 Request processed in 26494us (30195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602569.963504:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:3.0:1787602569.983908:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602569.985641:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833755776 00000100:00100000:2.0:1787602569.985659:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833755776 00000100:00100000:2.0:1787602569.985776:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 186 00000100:00100000:2.0:1787602569.985798:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+17:11519:x1874436833755776:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787602569.985919:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbe43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.985943:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbe43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.985959:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbe43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.988483:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbe4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.988521:0:8208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbe0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2634 expref: 18 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.988663:0:8208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbe4a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.988732:0:8208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbe0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2634 expref: 18 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602569.988768:0:8208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbe0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2634 expref: 18 pid: 8208 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602569.988788:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853675776:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602569.988908:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a0f0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602570.007295:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602570.007373:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853675776:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602570.007420:0:8208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbe4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602570.007473:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833755904 00000100:00100000:2.0:1787602570.007482:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833755904 00010000:00010000:2.0:1787602570.007529:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbe0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2634 expref: 19 pid: 8208 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602570.007568:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 73 00000100:00100000:2.0:1787602570.007579:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+19:2351:x1874436833755904:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602570.007598:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602570.007607:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbe0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2634 expref: 19 pid: 8208 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.007622:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbe0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2634 expref: 19 pid: 8208 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.009950:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbe0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2634 expref: 19 pid: 8208 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.009983:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d350b502c00) 00010000:00010000:2.0:1787602570.009989:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbe4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.009999:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbe4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.010007:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbe4a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.010056:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602570.010143:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+18:2351:x1874436833755904:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 2563us (2865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602570.010155:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 73 00010000:00010000:2.0:1787602570.010211:0:8208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbe4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.010220:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbe4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602570.010512:0:8208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1787602570.012855:0:8208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1787602570.012982:0:8208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1787602570.014772:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8208:1874436853675904:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787602570.014879:0:8208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602570.014930:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af52840 going to sleep for 11 seconds 00000100:00100000:2.0:1787602570.014969:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853675904 00000100:00100000:2.0:1787602570.014978:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853675904 00000100:00100000:2.0:1787602570.015048:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787602570.015915:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8208:x1874436853675904:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787602570.016046:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8208:x1874436853675904:12345-0@lo:1000:mdt00_003.0 Request processed in 986us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602570.016055:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787602570.016884:0:8208:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1787602570.016893:0:8208:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d3503e4c700, transno 4294967315 00000100:00100000:2.0:1787602570.016919:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8208:1874436853675904:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787602570.021945:0:8208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1787602570.022302:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8208:1874436853676032:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787602570.022401:0:8208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602570.022444:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a0f0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602570.022814:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853676032 00000100:00100000:2.0:1787602570.022825:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853676032 00000100:00100000:2.0:1787602570.022884:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787602570.022895:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8208:x1874436853676032:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787602570.023138:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8208:x1874436853676032:12345-0@lo:1000:mdt00_003.0 Request processed in 244us (737us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787602570.023148:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787602570.023207:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8208:1874436853676032:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787602570.023270:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbe4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023284:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbe4a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023292:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbe4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023299:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602570.023305:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbe4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023313:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbe4a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023337:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d350b502c00) 00010000:00010000:2.0:1787602570.023341:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602570.023358:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbe4a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023366:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dbe4a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023405:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dbd86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023413:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dbd86 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023419:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dbd86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023424:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602570.023427:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dbd86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023434:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dbd86 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023443:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81500) 00010000:00010000:2.0:1787602570.023445:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602570.023449:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dbd86 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023454:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dbd86 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023482:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbe51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023499:0:8208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbda2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2618 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023516:0:8208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbe51 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023550:0:8208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbda2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2618 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.023569:0:8208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbda2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2618 expref: 21 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602570.026212:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3503e4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853676160:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602570.026379:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3502978840 going to sleep for 11 seconds 00000100:00100000:2.0:1787602570.034210:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602570.034275:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833756032 00000100:00100000:2.0:1787602570.034288:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833756032 00010000:00010000:2.0:1787602570.034573:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbda2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2618 expref: 22 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602570.034862:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3503e4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853676160:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602570.034897:0:8208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbe51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602570.035197:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 74 00000100:00100000:2.0:1787602570.035211:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+22:2351:x1874436833756032:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602570.035242:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602570.035252:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbda2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2618 expref: 22 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.035267:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbda2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2618 expref: 22 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.036455:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dbda2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2618 expref: 22 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.036484:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81500) 00010000:00010000:2.0:1787602570.036490:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbe51 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.036502:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbe51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.036510:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbe51 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602570.036541:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602570.037168:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+21:2351:x1874436833756032:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 1956us (2969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602570.037180:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 74 00010000:00010000:3.0:1787602570.037409:0:8208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbe51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602570.037419:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbe51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602570.037435:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbe51 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602570.037441:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbe51 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602570.037460:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbe51 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602570.037467:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602570.037472:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbe51 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602570.037481:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbe51 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602570.037493:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81500) 00010000:00010000:3.0:1787602570.037504:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602570.037509:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbe51 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602570.037515:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbe51 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602570.037531:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbe43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602570.037537:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbe43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602570.037544:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbe43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602570.037548:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602570.037551:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbe43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602570.037557:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbe43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602570.037565:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350cd81500) 00010000:00010000:3.0:1787602570.037568:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787602570.037570:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbe43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602570.037577:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbe43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602570.041213:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+20:11519:x1874436833755776:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 55401us (57304us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787602570.041257:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 186 00000020:00080000:3.0:1787602570.041266:0:8208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787602570.041477:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787602570.042877:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787602570.043466:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787602570.043480:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787602570.049272:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602570.050280:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833756288 00000100:00100000:1.0:1787602570.050407:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833756288 00000100:00100000:1.0:1787602570.050493:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 50 00000100:00100000:1.0:1787602570.050505:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3527f62450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+20:11519:x1874436833756288:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787602570.062192:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787602570.065895:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1787602570.066024:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbe58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602570.066261:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbe58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602570.066281:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbe58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602570.066292:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbe58 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602570.066372:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbe58 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602570.066380:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbe58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602570.066405:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787602570.066887:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3527f62450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+22:11519:x1874436833756288:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 16376us (17623us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787602570.066900:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 50 00000020:00080000:1.0:1787602570.066909:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787602570.067004:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602570.067813:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbe58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602570.067826:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eba00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602570.067832:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbe58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602570.067843:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbe58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602570.067883:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d350cd81300) 00010000:00010000:1.0:1787602570.067887:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787602570.067893:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbe58 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602570.067899:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eba00/0x3640686da09dbe58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602570.067924:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602570.067926:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602570.067928:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602570.349314:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353557d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853676288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602570.349420:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602570.349597:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853676288 00000100:00100000:1.0:1787602570.349609:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853676288 00000100:00100000:1.0:1787602570.349695:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787602570.349717:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874436853676288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602570.349794:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602570.349865:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874436853676288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602570.349874:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787602570.350299:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353557d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853676288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602570.455732:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602570.455844:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602570.455884:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602570.455905:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602570.455943:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833756800 00000100:00100000:1.0:1787602570.455955:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833756800 00000100:00100000:1.0:1787602570.456147:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833756672 00000100:00100000:1.0:1787602570.456151:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833756672 00000100:00100000:1.0:1787602570.456182:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 96 00000100:00100000:1.0:1787602570.456196:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833756800:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602570.456429:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833756800:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 236us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602570.456439:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 96 00000100:00100000:1.0:1787602570.456461:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 97 00000100:00100000:1.0:1787602570.456468:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cb3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2353:x1874436833756672:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602570.456497:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cb3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2353:x1874436833756672:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 30us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602570.456504:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 97 00000100:00080000:1.0:1787602570.456683:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602570.456857:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833756544 00000100:00100000:3.0:1787602570.456862:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833756544 00000100:00100000:3.0:1787602570.456900:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 165 00000100:00100000:3.0:1787602570.456906:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+22:2354:x1874436833756544:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602570.456943:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+22:2354:x1874436833756544:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 37us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602570.456949:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 165 00000100:00100000:1.0:1787602570.457486:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602570.457645:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833756928 00000100:00100000:3.0:1787602570.457651:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833756928 00000100:00100000:3.0:1787602570.457701:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 166 00000100:00100000:3.0:1787602570.457719:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833756928:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602570.457792:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2353:x1874436833756928:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 84us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602570.457799:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 166 00000100:00080000:3.0:1787602570.457823:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602570.458627:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833756416 00000100:00100000:2.0:1787602570.458637:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833756416 00000100:00100000:2.0:1787602570.458688:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 300 00000100:00100000:2.0:1787602570.458696:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2353:x1874436833756416:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602570.458795:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2353:x1874436833756416:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 99us (2950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602570.458802:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 300 00010000:00010000:3.0:1787602570.925686:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787602571.053889:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602571.053902:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602571.053970:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787602571.053977:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787602571.460230:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00010000:00010000:2.0:1787602571.950079:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787602571.960135:0:12561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787602571.960150:0:12561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787602571.960202:0:12561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787602571.960215:0:12561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787602572.086457:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602572.086528:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833757184 00000100:00100000:3.0:1787602572.086538:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833757184 00000100:00100000:3.0:1787602572.086612:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 187 00000100:00100000:3.0:1787602572.086623:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353557fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+22:11538:x1874436833757184:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602572.086653:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602572.086678:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbe5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2650 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.086993:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dbe66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.087008:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dbe66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.087032:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dbe66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602572.087043:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787602572.087233:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbe5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2650 expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.087249:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dbe66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2650 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.087258:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:3.0:1787602572.087261:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787602572.087264:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433000, rc 0) 00000100:00100000:3.0:1787602572.087332:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353557fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+24:11538:x1874436833757184:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 712us (889us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787602572.087350:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 187 00000100:00080000:1.0:1787602572.087721:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602572.090388:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602572.090513:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833757312 00000100:00100000:3.0:1787602572.090525:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833757312 00000100:00100000:3.0:1787602572.090597:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 188 00000100:00100000:3.0:1787602572.090609:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+24:11538:x1874436833757312:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:3.0:1787602572.090695:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.090723:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.090735:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.090917:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.090925:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.090932:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091249:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbe82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091259:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbe82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091267:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbe82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787602572.091322:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbe82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091336:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091342:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091349:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091356:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602572.091361:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091369:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091384:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:3.0:1787602572.091388:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602572.091394:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091400:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091412:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091418:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091429:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091437:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602572.091440:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091448:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091455:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3529dc7c00) 00010000:00010000:3.0:1787602572.091458:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602572.091461:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091467:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091484:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbe82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091491:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbe82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091497:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbe82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091503:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602572.091506:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbe82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091519:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbe82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091527:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3529dc7100) 00010000:00010000:3.0:1787602572.091530:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602572.091533:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbe82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.091538:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbe82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602572.091635:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+24:11538:x1874436833757312:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 1026us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602572.091645:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 188 00000100:00100000:3.0:1787602572.147414:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602572.147476:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833757568 00000100:00100000:3.0:1787602572.147486:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833757568 00000100:00100000:3.0:1787602572.147540:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 189 00000100:00100000:3.0:1787602572.147551:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+24:11541:x1874436833757568:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602572.147572:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602572.147591:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbe89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2657 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.147663:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.147678:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.147699:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.147715:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.147723:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.147730:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148088:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbe9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148097:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbe9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148105:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbe9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602572.148116:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787602572.148222:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148231:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148238:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148244:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602572.148253:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148261:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148274:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:3.0:1787602572.148277:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602572.148282:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148289:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbe90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148299:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148305:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148311:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148317:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602572.148320:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148326:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148332:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3529dc7100) 00010000:00010000:3.0:1787602572.148335:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602572.148344:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148350:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbe97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148391:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbe89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2657 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148418:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbe9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2657 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.148425:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3529dc7c00) 00010000:00010000:3.0:1787602572.148427:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602572.148430:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433800, rc 0) 00000100:00100000:3.0:1787602572.148491:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+26:11541:x1874436833757568:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 942us (1087us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787602572.148498:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 189 00000100:00100000:3.0:1787602572.165837:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602572.167233:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833757696 00000100:00100000:3.0:1787602572.167247:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833757696 00000100:00100000:3.0:1787602572.167318:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 190 00000100:00100000:3.0:1787602572.167329:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+26:11541:x1874436833757696:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:3.0:1787602572.167401:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09dbeac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.167419:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09dbeac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.167431:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09dbeac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.167467:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09dbeac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.167475:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09dbeac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.167481:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09dbeac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.167487:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602572.167491:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09dbeac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.167499:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09dbeac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.167510:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3529dc7c00) 00010000:00010000:3.0:1787602572.170660:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787602572.170670:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09dbeac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.170681:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09dbeac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602572.170782:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+26:11541:x1874436833757696:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 3452us (4956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602572.170792:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 190 00000100:00100000:0.0:1787602572.179209:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602572.179982:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833757952 00000100:00100000:2.0:1787602572.179996:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833757952 00000100:00100000:2.0:1787602572.180061:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:2.0:1787602572.180073:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+26:11541:x1874436833757952:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:2.0:1787602572.180363:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+27:11541:x1874436833757952:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 291us (1174us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787602572.180372:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:3.0:1787602572.217450:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602572.217611:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833758208 00000100:00100000:0.0:1787602572.217623:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833758208 00000100:00100000:0.0:1787602572.217695:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 191 00000100:00100000:0.0:1787602572.217707:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+27:11067:x1874436833758208:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:0.0:1787602572.217792:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602572.217820:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbeb3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c265e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.217940:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbeba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.217955:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbe9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2657 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.217965:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbeba lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.218905:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbe9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2657 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.218926:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbe9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2657 expref: 28 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602572.218944:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874436853676416:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602572.219051:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af323c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602572.223700:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874436853676416:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602572.223785:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbeba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602572.226951:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602572.227193:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833758336 00000100:00100000:2.0:1787602572.227205:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833758336 00010000:00010000:2.0:1787602572.227270:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbe9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2657 expref: 29 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602572.227321:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 75 00000100:00100000:2.0:1787602572.227334:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+29:2352:x1874436833758336:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602572.227351:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602572.227377:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbe9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2657 expref: 29 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.227391:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbe9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2657 expref: 29 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.227415:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbe9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2657 expref: 29 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.227436:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3529dc7c00) 00010000:00010000:2.0:1787602572.227442:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbeba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.227453:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbeba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.227462:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbeba lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.227501:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602572.227535:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbeba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.227549:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbeba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602572.227573:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000100:00100000:2.0:1787602572.227580:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+28:2352:x1874436833758336:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 249us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602572.227588:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 75 00010000:00010000:3.0:1787602572.227805:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2000/0x3640686da09dbeb3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c265e expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.227829:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbeba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c265e expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.227837:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3529dc7c00) 00010000:00010000:3.0:1787602572.227840:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787602572.227842:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2600, rc 0) 00000100:00100000:3.0:1787602572.227882:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+28:11067:x1874436833758208:12345-192.168.201.26@tcp:101:bash.0 Request processed in 10166us (10433us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787602572.227890:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 191 00000100:00100000:0.0:1787602572.242267:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602572.242353:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833758592 00000100:00100000:2.0:1787602572.242371:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833758592 00000100:00100000:2.0:1787602572.242444:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 192 00000100:00100000:2.0:1787602572.242455:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+28:11067:x1874436833758592:12345-192.168.201.26@tcp:36:bash.0 00010000:00010000:2.0:1787602572.242852:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbec8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.242890:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.242902:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602572.242960:0:8208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787602572.242987:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000acff44d2 reply state 00000000245babf9 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602572.242996:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787602572.243044:0:8208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787602572.243195:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+32:11067:x1874436833758592:12345-192.168.201.26@tcp:36:bash.0 Request processed in 734us (930us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787602572.243203:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 192 00000020:00080000:2.0:1787602572.243208:0:8208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787602572.245897:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602572.246459:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833758720 00000100:00100000:3.0:1787602572.246470:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833758720 00000100:00100000:3.0:1787602572.246550:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 193 00000100:00100000:3.0:1787602572.246562:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+32:11067:x1874436833758720:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:3.0:1787602572.246589:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602572.246611:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09dbecf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2665 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.246677:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09dbecf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2665 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.246713:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09dbecf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2665 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.246739:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3529dc7c00) 00010000:00010000:3.0:1787602572.246763:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602572.246767:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432200, rc 0) 00000100:00100000:3.0:1787602572.246834:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+33:11067:x1874436833758720:12345-192.168.201.26@tcp:101:bash.0 Request processed in 274us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602572.246842:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 193 00010000:00010000:1.0:1787602572.248905:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.248923:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbec8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.248930:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbec8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.248944:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602572.248949:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbec8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.248973:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbec8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.248991:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3529dc7c00) 00010000:00010000:1.0:1787602572.248994:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602572.248998:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbec8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.249005:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dbec8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602572.251104:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602572.252000:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833758848 00000100:00100000:1.0:1787602572.252012:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833758848 00000100:00100000:1.0:1787602572.252096:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:1.0:1787602572.252108:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+7:11067:x1874436833758848:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787602572.252129:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602572.252151:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004de81032/0x3640686da09dbed6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c266c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787602572.252268:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1787602572.252371:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8ca689, atime: 0x6a8ca687, ctime: 0x6a8ca689, blocks: 0xb 00010000:00010000:1.0:1787602572.252396:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1787602572.252400:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602572.252409:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004de81032/0x3640686da09dbed6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c266c expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.252426:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004de81032/0x3640686da09dbed6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c266c expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.252460:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354ebc00, rc 0) 00000100:00100000:1.0:1787602572.252629:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+8:11067:x1874436833758848:12345-192.168.201.26@tcp:101:bash.0 Request processed in 523us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602572.252636:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:0.0:1787602572.255985:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602572.256089:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833758976 00000100:00100000:3.0:1787602572.256099:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833758976 00002000:00010000:3.0:1787602572.256141:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787602572.256146:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d35357eb100 with x1874436833758976 ext(0->18446744073709551615) 00002000:00010000:3.0:1787602572.256158:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d35357eb100. 00000100:00100000:3.0:1787602572.256338:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:3.0:1787602572.256351:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2351:x1874436833758976:12345-192.168.201.26@tcp:10:bash.0 00002000:00010000:3.0:1787602572.256704:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787602572.256708:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787602569 -> 1787602573 00002000:00010000:3.0:1787602572.256711:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787602567 -> 1787602567 00002000:00010000:3.0:1787602572.256714:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787602569 -> 1787602573 00002000:00010000:3.0:1787602572.256716:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787602572.257246:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+9:2351:x1874436833758976:12345-192.168.201.26@tcp:10:bash.0 Request processed in 893us (1265us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787602572.257256:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 5 00002000:00010000:2.0:1787602572.257260:0:6695:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1787602572.257263:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d35357eb100 with x1874436833758976 ext(0->18446744073709551615) 00002000:00010000:2.0:1787602572.257271:0:6695:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d35357eb100. 00000100:00100000:0.0:1787602572.352900:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602572.352959:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833759104 00000100:00100000:3.0:1787602572.352970:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833759104 00000100:00100000:3.0:1787602572.353047:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 194 00000100:00100000:3.0:1787602572.353058:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+32:11555:x1874436833759104:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:3.0:1787602572.353134:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbedd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.353151:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbedd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.353173:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbedd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.353198:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbee4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.353206:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.353212:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.353733:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbeeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.353861:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbeeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.353941:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbeeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787602572.354464:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbeeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354476:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbedd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354482:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbedd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354489:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbedd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354494:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602572.354498:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbedd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354591:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbedd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354605:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:0.0:1787602572.354608:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602572.354613:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbedd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354619:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbedd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354633:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354639:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbee4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354644:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354648:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602572.354651:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354656:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbee4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354663:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3529dc7100) 00010000:00010000:0.0:1787602572.354665:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602572.354668:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbee4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354683:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbee4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354701:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbeeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354707:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbeeb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354713:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbeeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354719:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602572.354721:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbeeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354726:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbeeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354733:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3529dc7c00) 00010000:00010000:0.0:1787602572.354736:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602572.354738:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbeeb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.354836:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbeeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602572.355015:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+32:11555:x1874436833759104:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 1953us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602572.355026:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 194 00000100:00100000:2.0:1787602572.406288:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787602572.406320:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35357e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853676544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602572.406414:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602572.408310:0:10486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853676544 00000100:00100000:3.0:1787602572.408324:0:10486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853676544 00000100:00100000:3.0:1787602572.408430:0:10486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787602572.408460:0:10486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874436853676544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602572.408503:0:10486:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602572.408591:0:10486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874436853676544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (2176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602572.408598:0:10486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1787602572.408837:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602572.409239:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35357e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853676544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602572.430146:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602572.430667:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833759360 00000100:00100000:2.0:1787602572.430693:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833759360 00000100:00100000:2.0:1787602572.430787:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 195 00000100:00100000:2.0:1787602572.430800:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+32:11558:x1874436833759360:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787602572.430822:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602572.430846:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbef2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2673 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.430936:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbef9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.430967:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbef9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.430981:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbef9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.430997:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbf00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431004:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbf00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431011:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbf00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431558:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbf07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431570:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbf07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431578:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbf07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602572.431597:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787602572.431702:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbef9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431711:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbef9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431717:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431723:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602572.431727:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431734:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbef9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431785:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:2.0:1787602572.431791:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602572.431797:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbef9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431804:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbef9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431818:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbf00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431825:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbf00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431842:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbf00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431848:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602572.431851:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbf00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431857:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbf00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431865:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3504d95500) 00010000:00010000:2.0:1787602572.431868:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602572.431871:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbf00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431877:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbf00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.431924:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dbef2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2673 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.432610:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbf07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2673 expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.432622:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3529dc7c00) 00010000:00010000:2.0:1787602572.432624:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787602572.432627:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5400, rc 0) 00000100:00100000:2.0:1787602572.432907:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+34:11558:x1874436833759360:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 2106us (2774us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787602572.432931:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 195 00000100:00100000:1.0:1787602572.441229:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602572.441320:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833759488 00000100:00100000:2.0:1787602572.441332:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833759488 00000100:00100000:2.0:1787602572.441403:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 196 00000100:00100000:2.0:1787602572.441415:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+34:11558:x1874436833759488:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:2.0:1787602572.441485:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbf15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.441503:0:8208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbeba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c265e expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.441524:0:8208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbf15 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.441563:0:8208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbeba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c265e expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.441578:0:8208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbeba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c265e expref: 34 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602572.441593:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853676672:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602572.441696:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af323c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602572.446359:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853676672:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602572.446393:0:8208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbf15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602572.447823:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602572.447976:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833759744 00000100:00100000:2.0:1787602572.448003:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833759744 00000100:00100000:2.0:1787602572.448069:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 52 00000100:00100000:2.0:1787602572.448080:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+35:6052:x1874436833759744:12345-192.168.201.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787602572.448460:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+36:6052:x1874436833759744:12345-192.168.201.26@tcp:35:ldlm_bl.0 Request processed in 381us (645us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787602572.448468:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 52 00000100:00100000:0.0:1787602572.451644:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602572.451817:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833759872 00000100:00100000:3.0:1787602572.451830:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833759872 00010000:00010000:3.0:1787602572.451888:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbeba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c265e expref: 36 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602572.451928:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 76 00000100:00100000:3.0:1787602572.451938:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3509d55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+36:2352:x1874436833759872:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602572.451955:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602572.451963:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbeba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c265e expref: 36 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.451977:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbeba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c265e expref: 36 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.452001:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbeba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c265e expref: 36 pid: 5837 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.452024:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3529dc7c00) 00010000:00010000:3.0:1787602572.452029:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbf15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.452040:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbf15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.452068:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbf15 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.452264:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602572.452329:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3509d55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+35:2352:x1874436833759872:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 391us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602572.452338:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 76 00010000:00010000:0.0:1787602572.453958:0:8208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbf15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.453974:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbf15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.454008:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbf15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.454015:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbf15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.454022:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbf15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.454028:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602572.454032:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbf15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.454039:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbf15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.454053:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3529dc7c00) 00010000:00010000:0.0:1787602572.454056:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602572.454060:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbf15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.454067:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5800/0x3640686da09dbf15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602572.454177:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+34:11558:x1874436833759488:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 12761us (12965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602572.454212:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 196 00000100:00100000:1.0:1787602572.461968:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602572.462113:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833760128 00000100:00100000:2.0:1787602572.462124:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833760128 00000100:00100000:2.0:1787602572.462193:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:2.0:1787602572.462205:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+34:11558:x1874436833760128:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:2.0:1787602572.462467:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+35:11558:x1874436833760128:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 263us (508us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787602572.462476:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:2.0:1787602572.640290:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602572.640514:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833760384 00000100:00100000:3.0:1787602572.640529:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833760384 00000100:00100000:3.0:1787602572.640598:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 197 00000100:00100000:3.0:1787602572.640610:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+35:11569:x1874436833760384:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:3.0:1787602572.640637:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602572.640660:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09dbf1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c267a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.640786:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbf23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.640802:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbf23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.640815:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbf23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.640832:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbf2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.640840:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbf2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.640867:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbf2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.641696:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbf31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.641708:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbf31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.641717:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbf31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602572.641727:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787602572.641856:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbf23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.641864:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbf23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.641871:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbf23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.641877:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602572.641882:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbf23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.641889:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbf23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.641902:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:3.0:1787602572.641905:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602572.641918:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbf23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.641925:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbf23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.641937:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbf2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.641943:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbf2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.641949:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbf2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.641954:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602572.641957:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbf2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.641963:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbf2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.641972:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3529dc7d00) 00010000:00010000:3.0:1787602572.641974:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602572.641978:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbf2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.641983:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbf2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.643280:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09dbf1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c267a expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.643330:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbf31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c267a expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.643346:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3529dc7c00) 00010000:00010000:3.0:1787602572.643349:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602572.643351:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433a00, rc 0) 00000100:00100000:3.0:1787602572.643434:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+37:11569:x1874436833760384:12345-192.168.201.26@tcp:101:cat.0 Request processed in 2826us (3161us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787602572.643443:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 197 00000100:00100000:1.0:1787602572.653863:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602572.653968:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833760640 00000100:00100000:2.0:1787602572.653988:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833760640 00000100:00100000:2.0:1787602572.654148:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 54 00000100:00100000:2.0:1787602572.654165:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+37:11569:x1874436833760640:12345-192.168.201.26@tcp:35:cat.0 00000100:00100000:2.0:1787602572.655037:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+38:11569:x1874436833760640:12345-192.168.201.26@tcp:35:cat.0 Request processed in 871us (1177us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787602572.655048:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 54 00000100:00100000:1.0:1787602572.706886:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602572.707011:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833760896 00000100:00100000:0.0:1787602572.707040:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833760896 00000100:00100000:0.0:1787602572.707147:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 198 00000100:00100000:0.0:1787602572.707173:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+38:11570:x1874436833760896:12345-192.168.201.26@tcp:36:rm.0 00010000:00010000:0.0:1787602572.707275:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787602572.707310:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dbf31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c267a expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.707604:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dbf07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2673 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.707621:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432200/0x3640686da09dbecf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2665 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.707632:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d3529dc7c00) 00010000:00010000:0.0:1787602572.707644:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787602572.707669:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbf3f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.707686:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbf3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.707697:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbf3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.707719:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbf46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.708050:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbf46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.708059:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbf46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.708484:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbf4d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.708494:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbf4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.708502:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbf4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787602572.709150:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1787602572.709161:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357655417098ns, next at 358655414408ns, rc = 0 00010000:00010000:0.0:1787602572.709234:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbf54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709244:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbf54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709253:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbf54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709261:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbf54 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709268:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbf54 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709285:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbf54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709315:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787602572.709341:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbf4d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709348:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbf4d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709355:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbf4d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709360:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602572.709365:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbf4d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709372:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbf4d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709384:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350b502600) 00010000:00010000:0.0:1787602572.709388:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787602572.709392:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbf4d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709398:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dbf4d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709415:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbf3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709420:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbf3f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709431:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbf3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709436:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602572.709438:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbf3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709444:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbf3f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709452:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:0.0:1787602572.709454:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602572.709457:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbf3f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602572.709462:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3e00/0x3640686da09dbf3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787602572.709473:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f00e36cc reply state 000000009c026625 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbf46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602572.709481:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602572.709585:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+37:11570:x1874436833760896:12345-192.168.201.26@tcp:36:rm.0 Request processed in 2423us (2713us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787602572.709594:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 198 00010000:00010000:2.0:1787602572.709858:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602572.709867:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbf54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.709872:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3200 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602572.709883:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbf54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.709890:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbf54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.709900:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d350b502600) 00010000:00010000:2.0:1787602572.709903:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787602572.709906:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbf54 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.709911:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dbf54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.709927:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602572.709929:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602572.709931:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602572.723347:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbf46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.723369:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbf46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.723376:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbf46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.723383:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e2600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602572.723389:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbf46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.723397:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbf46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.723418:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d350b502000) 00010000:00010000:1.0:1787602572.723423:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602572.723448:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbf46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.723454:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dbf46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602572.881034:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602572.881164:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833761152 00000100:00100000:2.0:1787602572.881183:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833761152 00000100:00100000:2.0:1787602572.881242:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 199 00000100:00100000:2.0:1787602572.881253:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+36:11576:x1874436833761152:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787602572.881277:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602572.881300:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbf5b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2681 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.881445:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbf62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.881459:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbf62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.881470:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbf62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.881502:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbf69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.881510:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbf69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.881517:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbf69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787602572.882303:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787602572.882546:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbf70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.882557:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbf70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.882565:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbf70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.882597:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbf62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.882605:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbf62 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.882612:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbf62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.882618:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602572.882622:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbf62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.882642:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbf62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.882655:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:2.0:1787602572.882658:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602572.882662:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbf62 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.882668:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dbf62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602572.882682:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c565984 reply state 000000009466797c transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbf69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602572.882691:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787602572.882722:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dbf5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2681 expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.882735:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbf70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2681 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.882795:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3504d95f00) 00010000:00010000:2.0:1787602572.882799:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602572.882801:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4e00, rc 0) 00000100:00100000:2.0:1787602572.882878:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+39:11576:x1874436833761152:12345-192.168.201.26@tcp:101:bash.0 Request processed in 1626us (1854us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787602572.882886:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 199 00010000:00010000:1.0:1787602572.884972:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbf69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.884990:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbf69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.884997:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbf69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.885004:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602572.885136:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbf69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.885146:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbf69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.885163:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3504d95500) 00010000:00010000:1.0:1787602572.885167:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602572.885171:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbf69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.885189:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dbf69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602572.892242:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602572.893619:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833761280 00000100:00100000:3.0:1787602572.893632:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833761280 00000100:00100000:3.0:1787602572.893803:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:3.0:1787602572.893815:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2351:x1874436833761280:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:3.0:1787602572.893834:0:8625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602572.893859:0:8625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbf7e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2688 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787602572.893890:0:8625:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787602572.893910:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1787602572.893915:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602572.893926:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbf7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2688 expref: 6 pid: 8625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.893947:0:8625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbf7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2688 expref: 6 pid: 8625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.893984:0:8625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432000, rc 0) 00000100:00100000:3.0:1787602572.894076:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2351:x1874436833761280:12345-192.168.201.26@tcp:101:bash.0 Request processed in 263us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602572.894083:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00080000:1.0:1787602572.894864:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787602572.906462:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602572.906563:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833761408 00000100:00100000:2.0:1787602572.906591:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833761408 00000100:00100000:2.0:1787602572.906655:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 62 00000100:00100000:2.0:1787602572.906666:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+6:11576:x1874436833761408:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787602572.906684:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602572.906705:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c268f expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.906740:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbf7e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2688 expref: 7 pid: 8625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.906781:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602572.906787:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602572.906794:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c268f expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.906831:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbf7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2688 expref: 7 pid: 8625 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602572.906846:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbf7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2688 expref: 7 pid: 8625 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602572.906861:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1874436853676800:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602572.906973:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32540 going to sleep for 11 seconds 00000100:00100000:1.0:1787602572.909436:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1874436853676800:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602572.909478:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c268f expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602572.909500:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5a00, rc 0) 00000100:00100000:1.0:1787602572.909570:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+7:11576:x1874436833761408:12345-192.168.201.26@tcp:101:bash.0 Request processed in 2905us (3116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602572.909580:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 62 00000100:00100000:0.0:1787602572.910996:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602572.911528:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833761536 00000100:00100000:3.0:1787602572.911538:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833761536 00010000:00010000:3.0:1787602572.911583:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbf7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2688 expref: 7 pid: 8625 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602572.911672:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 77 00000100:00100000:3.0:1787602572.911682:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2352:x1874436833761536:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602572.911697:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602572.911721:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbf7e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2688 expref: 7 pid: 8625 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.911736:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbf7e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2688 expref: 7 pid: 8625 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.911784:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbf7e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2688 expref: 7 pid: 8625 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.911801:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602572.911805:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602572.911813:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c268f expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.911836:0:11167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c268f expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602572.911875:0:11167:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c268f expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602572.911889:0:11167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11167:1874436853676928:192.168.201.26@tcp:105: 00000100:00100000:3.0:1787602572.911987:0:11167:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353976f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602572.925163:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602572.925549:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833761792 00000100:00100000:1.0:1787602572.925561:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833761792 00000100:00100000:1.0:1787602572.925630:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00100000:1.0:1787602572.925641:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+38:11576:x1874436833761792:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:1.0:1787602572.926073:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+39:11576:x1874436833761792:12345-192.168.201.26@tcp:35:bash.0 Request processed in 434us (922us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1787602572.926082:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00100000:3.0:1787602572.929467:0:11167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11167:1874436853676928:192.168.201.26@tcp:105: 00010000:00010000:3.0:1787602572.929496:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602572.929567:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2352:x1874436833761536:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 17885us (18576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602572.929577:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 77 00010000:00010000:3.0:1787602572.973436:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602573.155328:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602573.155447:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833761920 00000100:00100000:2.0:1787602573.155457:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833761920 00000100:00100000:2.0:1787602573.155517:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 200 00000100:00100000:2.0:1787602573.155527:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+39:11592:x1874436833761920:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787602573.155567:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602573.155588:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbf8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2696 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.155654:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbf93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.155668:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbf93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.155681:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbf93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602573.155739:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787602573.155772:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602573.155797:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbf93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.155824:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dbf8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2696 expref: 41 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.155841:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbf93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2696 expref: 40 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.155850:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:2.0:1787602573.155853:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787602573.155856:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4200, rc 0) 00000100:00100000:2.0:1787602573.155922:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+40:11592:x1874436833761920:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 396us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602573.155928:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 200 00000100:00100000:0.0:1787602573.161313:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602573.161506:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833762176 00000100:00100000:3.0:1787602573.161517:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833762176 00000100:00100000:3.0:1787602573.161573:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 201 00000100:00100000:3.0:1787602573.161583:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+40:11592:x1874436833762176:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602573.161607:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602573.161630:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09dbf9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c269d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.161765:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbfa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.161791:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbfa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.161804:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbfa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602573.161817:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787602573.161947:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09dbf9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c269d expref: 43 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.161964:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbfa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c269d expref: 42 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.161973:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3504d95f00) 00010000:00010000:3.0:1787602573.161976:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602573.161979:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433c00, rc 0) 00000100:00100000:3.0:1787602573.162039:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+42:11592:x1874436833762176:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 457us (738us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787602573.162046:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 201 00000100:00100000:1.0:1787602573.166865:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602573.166911:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602573.166993:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833762304 00000100:00100000:2.0:1787602573.167003:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833762304 00000100:00100000:2.0:1787602573.167079:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:2.0:1787602573.167089:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+42:2351:x1874436833762304:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602573.167114:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602573.167140:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433c00/0x3640686da09dbfa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c269d expref: 42 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.167160:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3504d95f00) 00010000:00010000:2.0:1787602573.167165:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602573.167242:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+41:2351:x1874436833762304:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 154us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602573.167249:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:0.0:1787602573.167445:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833762560 00000100:00100000:0.0:1787602573.167450:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833762560 00000100:00100000:0.0:1787602573.167493:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 202 00000100:00100000:0.0:1787602573.167501:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+41:11592:x1874436833762560:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602573.167521:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602573.167536:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09dbfaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c26a4 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.167624:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dbfb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.167639:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dbfb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.167650:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dbfb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602573.167662:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787602573.168084:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2a00/0x3640686da09dbfaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26a4 expref: 44 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.168104:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dbfb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26a4 expref: 43 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.168112:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3504d95f00) 00010000:00010000:0.0:1787602573.168115:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787602573.168117:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2e00, rc 0) 00000100:00100000:0.0:1787602573.168165:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+43:11592:x1874436833762560:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 665us (1253us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787602573.168199:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 202 00000100:00100000:1.0:1787602573.182420:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602573.182691:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833762688 00000100:00100000:3.0:1787602573.182703:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833762688 00000100:00100000:3.0:1787602573.182854:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 63 00000100:00100000:3.0:1787602573.182865:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+6:2353:x1874436833762688:12345-192.168.201.26@tcp:1:lfs.0 00010000:00010000:3.0:1787602573.182912:0:8625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbfc4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.182934:0:8625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c268f expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.182960:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787602573.182965:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787602573.182969:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbfc4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.183007:0:8625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c268f expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.183022:0:8625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c268f expref: 6 pid: 6690 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602573.183037:0:8625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1874436853677056:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787602573.183115:0:8625:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353976f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602573.186378:0:8625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8625:1874436853677056:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602573.186420:0:8625:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbfc4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602573.189350:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602573.189463:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833762816 00000100:00100000:0.0:1787602573.189475:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833762816 00002000:00100000:0.0:1787602573.189982:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d353d265500 x1874436833762816/t0(0) o4->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:409/0 lens 504/0 e 0 to 0 dl 1787602584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787602573.189997:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d353d265500 with x1874436833762816 ext(0->8) 00010000:00010000:0.0:1787602573.190009:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c268f expref: 7 pid: 6690 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.190029:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c268f expref: 7 pid: 6690 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787602573.190037:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d353d265500 00000100:00100000:0.0:1787602573.190079:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:0.0:1787602573.190092:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2352:x1874436833762816:12345-192.168.201.26@tcp:4:lfs.0 00000100:00100000:0.0:1787602573.191180:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+9:2352:x1874436833762816:12345-192.168.201.26@tcp:4:lfs.0 Request processed in 1078us (1827us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787602573.191190:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 3 00002000:00100000:0.0:1787602573.191200:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d353d265500 x1874436833762816/t4294967308(0) o4->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:409/0 lens 504/448 e 0 to 0 dl 1787602584 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787602573.191208:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d353d265500 with x1874436833762816 ext(0->8) 00010000:00010000:0.0:1787602573.191216:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c268f expref: 9 pid: 6690 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.191255:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c268f expref: 9 pid: 6690 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787602573.191263:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d353d265500 00000100:00100000:2.0:1787602573.194625:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602573.197110:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833762944 00000100:00100000:0.0:1787602573.197126:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833762944 00010000:00010000:0.0:1787602573.197182:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c268f expref: 9 pid: 6690 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602573.197232:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 78 00000100:00100000:0.0:1787602573.197387:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+9:2351:x1874436833762944:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602573.197468:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787602573.197491:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787602573.197708:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787602573 00002000:00010000:0.0:1787602573.197710:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787602574 00002000:00010000:0.0:1787602573.197713:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787602573 00010000:00010000:0.0:1787602573.197721:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c268f expref: 9 pid: 6690 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.197735:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c268f expref: 9 pid: 6690 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.197779:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006ad78b2/0x3640686da09dbf85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c268f expref: 9 pid: 6690 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.197818:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602573.197822:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602573.197828:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbfc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.197838:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbfc4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.197914:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602573.197984:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2351:x1874436833762944:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 742us (3367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602573.197993:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 78 00010000:00010000:3.0:1787602573.198986:0:8625:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbfc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.199000:0:8625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbfc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.199030:0:8625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbfc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.199048:0:8625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbfc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.199056:0:8625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbfc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.199063:0:8625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432000 already unused, calling callback (ffffffffc1656230) 00010000:00010000:3.0:1787602573.199068:0:8625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbfc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.199077:0:8625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbfc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.199093:0:8625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbfc4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.199101:0:8625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009668b0b8/0x3640686da09dbfc4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602573.199179:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2353:x1874436833762688:12345-192.168.201.26@tcp:1:lfs.0 Request processed in 16304us (16756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602573.199188:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 63 00000100:00100000:2.0:1787602573.202594:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602573.202907:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833763200 00000100:00100000:1.0:1787602573.202917:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833763200 00000100:00100000:1.0:1787602573.202972:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 56 00000100:00100000:1.0:1787602573.202983:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3527f62050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+43:11592:x1874436833763200:12345-192.168.201.26@tcp:35:lfs.0 00000004:00010000:1.0:1787602573.203056:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dbfb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26a4 expref: 43 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787602573.203358:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1787602573.203417:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1787602573.204525:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1787602573.204591:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbfcb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.204609:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbf70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2681 expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.204618:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbfcb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.204653:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbf70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2681 expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.204669:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbf70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2681 expref: 47 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602573.204682:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d265880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1874436853677184:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602573.205124:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b9483c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602573.209823:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602573.210265:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833763328 00000100:00100000:2.0:1787602573.210276:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833763328 00010000:00010000:2.0:1787602573.210331:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbf70 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2681 expref: 48 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602573.210377:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 79 00000100:00100000:2.0:1787602573.210388:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+48:2352:x1874436833763328:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602573.210413:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602573.210422:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbf70 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2681 expref: 48 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.210436:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbf70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2681 expref: 48 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.210475:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3504d95f00) 00010000:00010000:2.0:1787602573.210479:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbfcb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.210487:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbfcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.210492:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbfcb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.210511:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602573.210574:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+48:2352:x1874436833763328:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 187us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602573.210582:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 79 00010000:00010000:3.0:1787602573.211993:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dbf70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2681 expref: 47 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602573.212024:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d265880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1874436853677184:192.168.201.26@tcp:104: 00010000:00010000:3.0:1787602573.212046:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbfcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.212216:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbfcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.212223:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbfcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602573.212591:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787602573.213350:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1787602573.213548:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874436853677312:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787602573.213622:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602573.213723:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32540 going to sleep for 11 seconds 00000100:00100000:0.0:1787602573.218490:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853677312 00000100:00100000:0.0:1787602573.218505:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853677312 00000100:00100000:0.0:1787602573.218592:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787602573.218603:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874436853677312:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787602573.218738:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874436853677312:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 138us (5116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602573.218761:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787602573.218823:0:5840:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1787602573.218828:0:5840:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1787602573.218850:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d34074c9f80, transno 4294967307 00000100:00080000:1.0:1787602573.219097:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787602573.219229:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874436853677312:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787602573.221645:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787602573.221782:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35357eb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874436853677440:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787602573.223000:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602573.223086:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35298f2780 going to sleep for 11 seconds 00000100:00100000:2.0:1787602573.228047:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853677440 00000100:00100000:2.0:1787602573.228065:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853677440 00000100:00100000:2.0:1787602573.228358:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787602573.228370:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874436853677440:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787602573.228684:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1874436853677440:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 316us (5688us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787602573.228691:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787602573.228800:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35357eb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874436853677440:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787602573.228896:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1787602573.228941:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbfcb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.228951:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbfcb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.228958:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbfcb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.228964:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eb600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602573.228968:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbfcb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.228975:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbfcb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.228990:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3504d95f00) 00010000:00010000:0.0:1787602573.228993:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787602573.228997:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbfcb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.229003:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb600/0x3640686da09dbfcb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787602573.230453:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787602573.230575:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1787602573.230588:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358176843765ns, next at 359176840562ns, rc = 0 00000001:00080000:1.0:1787602573.230597:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787602573.230649:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3504d95f00) 00010000:00010000:1.0:1787602573.230663:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787602573.230674:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2e00/0x3640686da09dbfb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26a4 expref: 51 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602573.231008:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3527f62050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+50:11592:x1874436833763200:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 28025us (28423us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1787602573.231017:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 56 00000020:00080000:1.0:1787602573.231022:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787602573.234328:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602573.234409:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833763456 00000100:00100000:3.0:1787602573.234418:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833763456 00000100:00100000:3.0:1787602573.234468:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 203 00000100:00100000:3.0:1787602573.234474:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+50:11592:x1874436833763456:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602573.234495:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602573.234633:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09dbfd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c26ab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.234710:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09dbfd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ab expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.234726:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09dbfd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ab expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.234778:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:3.0:1787602573.234781:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602573.234785:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432000, rc 0) 00000100:00100000:3.0:1787602573.234939:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+51:11592:x1874436833763456:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 464us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602573.234945:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 203 00000100:00100000:0.0:1787602573.237898:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602573.238163:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833763712 00000100:00100000:2.0:1787602573.238181:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833763712 00000100:00100000:2.0:1787602573.238351:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:2.0:1787602573.238364:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+51:11592:x1874436833763712:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:2.0:1787602573.238638:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+52:11592:x1874436833763712:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 276us (748us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787602573.238645:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:0.0:1787602573.378013:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602573.378224:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833763840 00000100:00100000:1.0:1787602573.378234:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833763840 00000100:00100000:1.0:1787602573.378294:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 204 00000100:00100000:1.0:1787602573.378306:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+52:11602:x1874436833763840:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:1.0:1787602573.378380:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbfd9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.380005:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbfd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.380026:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbfd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.380121:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbfe0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.380132:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbfe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.380140:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbfe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.380301:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbfe7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.380310:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbfe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.380317:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbfe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602573.380366:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbfe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.380380:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbfd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.380387:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbfd9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381007:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbfd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381018:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602573.381023:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbfd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381032:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbfd9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381112:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:1.0:1787602573.381116:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602573.381121:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbfd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381137:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dbfd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381153:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbfe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381161:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbfe0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381179:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbfe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381185:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eb200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602573.381189:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbfe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381196:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbfe0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381204:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d350cd81500) 00010000:00010000:1.0:1787602573.381207:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602573.381210:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbfe0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381216:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dbfe0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381235:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbfe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381241:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbfe7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381253:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbfe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381258:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eac00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602573.381260:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbfe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381266:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbfe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381274:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:1.0:1787602573.381276:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602573.381279:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbfe7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.381285:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dbfe7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602573.382204:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+52:11602:x1874436833763840:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 3089us (3546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602573.382216:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 204 00000100:00100000:0.0:1787602573.465551:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602573.465648:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833764096 00000100:00100000:3.0:1787602573.465664:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833764096 00000100:00100000:3.0:1787602573.465721:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 205 00000100:00100000:3.0:1787602573.465730:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+52:11605:x1874436833764096:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602573.465772:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602573.465794:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbfee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c26b2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.465936:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbff5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.465951:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbff5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.465962:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbff5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.465974:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbffc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.465981:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.465987:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.466378:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dc003 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.466388:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dc003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.466557:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dc003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602573.466574:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787602573.466666:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbff5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.466673:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbff5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.466680:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbff5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.466685:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602573.466690:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbff5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.466697:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbff5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.466709:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:3.0:1787602573.466711:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602573.466715:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbff5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.466721:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dbff5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.466733:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.466738:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbffc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.466795:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbffc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.466800:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602573.466803:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbffc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.466809:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbffc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.466816:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3529dc7900) 00010000:00010000:3.0:1787602573.466818:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602573.466821:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbffc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.466827:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dbffc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.467960:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dbfee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26b2 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.467981:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dc003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26b2 expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.467989:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:3.0:1787602573.467991:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602573.467994:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432e00, rc 0) 00000100:00100000:3.0:1787602573.468175:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+54:11605:x1874436833764096:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 2436us (2678us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787602573.468194:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 205 00000100:00100000:0.0:1787602573.475913:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602573.476070:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833764224 00000100:00100000:1.0:1787602573.476080:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833764224 00000100:00100000:1.0:1787602573.476142:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 206 00000100:00100000:1.0:1787602573.476152:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+54:11605:x1874436833764224:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:1.0:1787602573.476233:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dc011 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.476260:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dc011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.476285:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dc011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.476311:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dc011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.476319:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dc011 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.476326:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dc011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.476331:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eac00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602573.476336:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dc011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.476343:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dc011 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.476356:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:1.0:1787602573.476359:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602573.476364:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dc011 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.476371:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eac00/0x3640686da09dc011 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602573.477906:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+54:11605:x1874436833764224:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 1747us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602573.477919:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 206 00000100:00100000:0.0:1787602573.482562:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602573.482641:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833764480 00000100:00100000:1.0:1787602573.482667:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833764480 00000100:00100000:1.0:1787602573.482731:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 58 00000100:00100000:1.0:1787602573.482765:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+54:11605:x1874436833764480:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:1.0:1787602573.483217:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+55:11605:x1874436833764480:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 475us (665us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787602573.483226:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 58 00000100:00100000:3.0:1787602573.625884:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602573.627424:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833764736 00000100:00100000:2.0:1787602573.627445:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833764736 00000100:00100000:2.0:1787602573.627674:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 207 00000100:00100000:2.0:1787602573.627689:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+55:11615:x1874436833764736:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787602573.627726:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602573.627730:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787602573.627807:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dbf93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2696 expref: 55 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.627834:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:2.0:1787602573.627840:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787602573.627860:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc018 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c26b9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.627996:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dc01f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.628037:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dc01f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.628049:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dc01f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602573.628063:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787602573.629798:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc018 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26b9 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.629840:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dc01f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26b9 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.629852:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:2.0:1787602573.629855:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602573.629859:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5a00, rc 0) 00000100:00100000:2.0:1787602573.629962:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+56:11615:x1874436833764736:12345-192.168.201.26@tcp:101:bash.0 Request processed in 2275us (4094us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787602573.629974:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 207 00000100:00100000:0.0:1787602573.633920:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602573.634817:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833764864 00000100:00100000:3.0:1787602573.634838:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833764864 00000100:00100000:3.0:1787602573.634939:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:3.0:1787602573.634952:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+56:2352:x1874436833764864:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602573.634972:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602573.635004:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5a00/0x3640686da09dc01f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26b9 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.635027:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:3.0:1787602573.635035:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602573.635129:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+55:2352:x1874436833764864:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 180us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602573.635139:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:0.0:1787602573.643851:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602573.643997:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833765120 00000100:00100000:1.0:1787602573.644025:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833765120 00000100:00100000:1.0:1787602573.644112:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 208 00000100:00100000:1.0:1787602573.644123:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+55:11615:x1874436833765120:12345-192.168.201.26@tcp:36:bash.0 00010000:00010000:1.0:1787602573.644193:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602573.644222:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dc003 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26b2 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.644253:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:1.0:1787602573.644259:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602573.645348:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dc02d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.645367:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dc02d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.645379:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dc02d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787602573.645559:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1787602573.645586:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000722e555e reply state 00000000e7c89804 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dc02d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602573.645615:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787602573.645723:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+57:11615:x1874436833765120:12345-192.168.201.26@tcp:36:bash.0 Request processed in 1600us (1884us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787602573.645732:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 208 00000020:00080000:1.0:1787602573.645736:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787602573.656604:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dc02d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.656624:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dc02d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.656632:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dc02d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.656638:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eb200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602573.656642:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dc02d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.656650:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dc02d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.656668:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:0.0:1787602573.656671:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602573.656675:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dc02d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.656681:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb200/0x3640686da09dc02d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602573.665929:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602573.666015:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833765248 00000100:00100000:2.0:1787602573.666025:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833765248 00000100:00100000:2.0:1787602573.666096:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 209 00000100:00100000:2.0:1787602573.666107:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+56:11615:x1874436833765248:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787602573.666137:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602573.666171:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc034 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c26c0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.666290:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc03b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.666308:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.666322:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602573.666354:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787602573.666358:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602573.666379:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.666420:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc034 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26c0 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.666438:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc03b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26c0 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.666447:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:2.0:1787602573.666450:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602573.666454:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4200, rc 0) 00000100:00100000:2.0:1787602573.666521:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+57:11615:x1874436833765248:12345-192.168.201.26@tcp:101:bash.0 Request processed in 415us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602573.666529:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 209 00000100:00100000:1.0:1787602573.679927:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602573.680138:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833765504 00000100:00100000:2.0:1787602573.680170:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833765504 00000100:00100000:2.0:1787602573.680273:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:2.0:1787602573.680285:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+57:11615:x1874436833765504:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:2.0:1787602573.681768:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+58:11615:x1874436833765504:12345-192.168.201.26@tcp:35:bash.0 Request processed in 1478us (1857us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787602573.681780:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:0.0:1787602573.743171:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602573.748443:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833765632 00000100:00100000:1.0:1787602573.748470:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833765632 00000100:00100000:1.0:1787602573.749940:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 210 00000100:00100000:1.0:1787602573.749958:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+58:11621:x1874436833765632:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787602573.750134:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602573.750175:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dc042 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c26c7 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.750653:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dc049 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.750674:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dc049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.750688:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dc049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602573.750802:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787602573.750808:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602573.750839:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dc049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.750872:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea000/0x3640686da09dc042 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26c7 expref: 60 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.750919:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dc049 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26c7 expref: 59 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.750930:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:1.0:1787602573.750933:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602573.750938:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354ebe00, rc 0) 00000100:00100000:1.0:1787602573.752808:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+59:11621:x1874436833765632:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 2839us (9647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602573.752822:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 210 00000100:00100000:0.0:1787602573.766138:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602573.766247:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833765760 00000100:00100000:3.0:1787602573.766261:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833765760 00000100:00100000:3.0:1787602573.766350:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 211 00000100:00100000:3.0:1787602573.766364:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+59:11621:x1874436833765760:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602573.766393:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602573.766422:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dc050 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c26ce expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.766586:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc057 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.766607:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.766647:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.766667:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc05e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.766676:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc05e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.766683:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc05e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.766865:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dc065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.766875:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dc065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.766883:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dc065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602573.766936:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787602573.766941:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602573.766967:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dc065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.766983:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dc065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.766993:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.767011:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc057 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.767018:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc057 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.767025:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602573.767031:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc057 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.767039:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc057 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.767055:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:3.0:1787602573.767059:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602573.767066:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc057 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.767073:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc057 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.767087:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc05e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.767093:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc05e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.767099:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc05e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.767105:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602573.767114:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc05e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.767121:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc05e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.767130:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3529dc7900) 00010000:00010000:3.0:1787602573.767132:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602573.767135:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc05e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.767141:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc05e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.767187:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433800/0x3640686da09dc050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ce expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.767202:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dc065 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ce expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.767209:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:3.0:1787602573.767212:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602573.767214:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432600, rc 0) 00000100:00100000:3.0:1787602573.767295:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+60:11621:x1874436833765760:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 933us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602573.767304:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 211 00000100:00100000:0.0:1787602573.772382:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602573.773663:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833766016 00000100:00100000:1.0:1787602573.773680:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833766016 00000100:00100000:0.0:1787602573.773850:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 212 00000100:00100000:0.0:1787602573.773866:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d48aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+60:11621:x1874436833766016:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602573.773894:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602573.773923:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc06c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c26d5 expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.774131:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.774150:0:8208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc03b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26c0 expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.774169:0:8208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dc065 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ce expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.774178:0:8208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.774230:0:8208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dc065 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ce expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.774248:0:8208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dc065 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ce expref: 61 pid: 5836 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602573.774265:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d489f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853677568:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787602573.774605:0:8208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc03b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26c0 expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.774635:0:8208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc03b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26c0 expref: 61 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602573.774645:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853677696:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787602573.777842:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602573.778050:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833766144 00000100:00100000:3.0:1787602573.778062:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833766144 00010000:00010000:3.0:1787602573.778114:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dc065 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ce expref: 62 pid: 5836 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602573.778188:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 80 00000100:00100000:3.0:1787602573.778199:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+62:2351:x1874436833766144:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602573.778218:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602573.778227:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dc065 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ce expref: 62 pid: 5836 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.778243:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dc065 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ce expref: 62 pid: 5836 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.778273:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:3.0:1787602573.778279:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.778290:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602573.778297:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602573.778370:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+62:2351:x1874436833766144:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 172us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602573.778379:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 80 00000100:00100000:0.0:1787602573.778959:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350855e600 going to sleep for 11 seconds 00010000:00010000:0.0:1787602573.781789:0:8208:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.26@tcp) returned -22 from blocking AST (req@0000000046585796 x1874436853677568) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dc065 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ce expref: 61 pid: 5836 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.781823:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432600/0x3640686da09dc065 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ce expref: 61 pid: 5836 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602573.781847:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d489f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853677568:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787602573.783947:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853677696:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787602573.783988:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:0.0:1787602573.783996:0:8208:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.784009:0:8208:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.784022:0:8208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602573.788065:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602573.788351:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833766272 00000100:00100000:2.0:1787602573.788365:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833766272 00010000:00010000:2.0:1787602573.788421:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc03b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26c0 expref: 61 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602573.788473:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 81 00000100:00100000:2.0:1787602573.788485:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3509d55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+61:2352:x1874436833766272:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602573.788505:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602573.788513:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc03b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26c0 expref: 61 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.788542:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc03b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26c0 expref: 61 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.788570:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc03b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26c0 expref: 61 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.788590:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:2.0:1787602573.788596:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.788607:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.788634:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.788674:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602573.788784:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3509d55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+60:2352:x1874436833766272:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 300us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602573.788793:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 81 00010000:00010000:1.0:1787602573.788977:0:8208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.788987:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602573.789013:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787602573.789229:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc06c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26d5 expref: 61 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.789249:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26d5 expref: 60 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602573.789259:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:1.0:1787602573.789262:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787602573.789265:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e3400, rc 0) 00000100:00100000:1.0:1787602573.789308:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d48aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+60:11621:x1874436833766016:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 15448us (16945us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787602573.789318:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 212 00000100:00100000:3.0:1787602573.793273:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602573.793497:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833766528 00000100:00100000:0.0:1787602573.793523:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833766528 00000100:00100000:0.0:1787602573.793634:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:0.0:1787602573.793648:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+60:11621:x1874436833766528:12345-192.168.201.26@tcp:103:lfs.0 00010000:00010000:0.0:1787602573.793672:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602573.793709:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09dbfd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ab expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.793736:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:0.0:1787602573.793791:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602573.793867:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+59:11621:x1874436833766528:12345-192.168.201.26@tcp:103:lfs.0 Request processed in 221us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602573.793875:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:3.0:1787602573.799792:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602573.799908:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833766656 00000100:00100000:2.0:1787602573.799921:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833766656 00000100:00100000:2.0:1787602573.800003:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 213 00000100:00100000:2.0:1787602573.800016:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+59:11621:x1874436833766656:12345-192.168.201.26@tcp:58:lfs.0 00010000:00010000:2.0:1787602573.800183:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc081 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.800204:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc081 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602573.800227:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc081 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787602573.800490:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787602573.800609:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+59:11621:x1874436833766656:12345-192.168.201.26@tcp:58:lfs.0 Request processed in 594us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602573.800618:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 213 00000100:00100000:1.0:1787602573.804526:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602573.812392:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833766784 00000100:00100000:0.0:1787602573.812415:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833766784 00000100:00100000:0.0:1787602573.812534:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 214 00000100:00100000:0.0:1787602573.812549:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+59:11621:x1874436833766784:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602573.812578:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602573.812607:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dc088 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c26dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.812690:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc081 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.812704:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dc088 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26dc expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.812732:0:5838:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc081 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.812841:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dc088 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26dc expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.812858:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:0.0:1787602573.812862:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787602573.812867:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dc088 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26dc expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602573.812876:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2600, rc 0) 00000100:00100000:0.0:1787602573.813044:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+60:11621:x1874436833766784:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 498us (8534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602573.813053:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 214 00010000:00010000:2.0:1787602573.997303:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787602574.124996:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787602574.125009:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787602574.125077:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787602574.125084:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787602574.125254:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d34074c9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874436853677824:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787602574.125412:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350855ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787602574.131618:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602574.131794:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833766912 00000100:00100000:2.0:1787602574.131808:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833766912 00000100:00100000:2.0:1787602574.131906:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 215 00000100:00100000:2.0:1787602574.131922:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+61:11622:x1874436833766912:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787602574.132012:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787602574.132168:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+61:11622:x1874436833766912:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 235us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602574.132176:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 215 00000100:00080000:3.0:1787602574.132288:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602574.135091:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602574.135623:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833767040 00000100:00100000:1.0:1787602574.135639:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833767040 00000100:00100000:1.0:1787602574.135737:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 216 00000100:00100000:1.0:1787602574.135781:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+61:11622:x1874436833767040:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787602574.135895:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dc08f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.135920:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dc08f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.135937:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dc08f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.135955:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc096 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.135963:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc096 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.135971:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc096 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.135999:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc09d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136010:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc09d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136037:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc09d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602574.136091:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787602574.136096:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602574.136112:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc09d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136125:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dc08f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136132:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dc08f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136140:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dc08f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136147:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eae00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602574.136165:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dc08f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136175:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dc08f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136190:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d350b502400) 00010000:00010000:1.0:1787602574.136193:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602574.136198:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dc08f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136204:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eae00/0x3640686da09dc08f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136240:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc096 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136248:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc096 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136254:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc096 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136260:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602574.136263:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc096 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136269:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc096 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136277:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8d350cd81500) 00010000:00010000:1.0:1787602574.136280:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602574.136283:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc096 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136289:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc096 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136305:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc09d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136312:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc09d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136318:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc09d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136329:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eaa00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602574.136332:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc09d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136339:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc09d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136348:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:1.0:1787602574.136350:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602574.136353:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc09d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.136359:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc09d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602574.136459:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+61:11622:x1874436833767040:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 Request processed in 681us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602574.136468:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 216 00000100:00100000:1.0:1787602574.139349:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602574.139457:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833767296 00000100:00100000:2.0:1787602574.139473:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833767296 00000100:00100000:2.0:1787602574.139555:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 217 00000100:00100000:2.0:1787602574.139578:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+61:11622:x1874436833767296:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602574.139607:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602574.139634:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc0a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c26e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.139815:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.139833:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.139847:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602574.139861:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787602574.140012:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.140021:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.140029:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.140052:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602574.140057:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.140067:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.140083:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:2.0:1787602574.140087:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787602574.140092:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.140099:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.140164:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc0a4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26e3 expref: 63 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.140177:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d350b502400) 00010000:00010000:2.0:1787602574.140180:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787602574.140184:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc0a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26e3 expref: 63 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.140196:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4e00, rc 0) 00000100:00100000:2.0:1787602574.140281:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+62:11622:x1874436833767296:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 706us (945us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1787602574.140290:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 217 00000100:00100000:0.0:1787602574.142448:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d34074c9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874436853677824:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787602574.144698:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602574.144986:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833767424 00000100:00100000:1.0:1787602574.145000:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833767424 00000100:00100000:1.0:1787602574.145077:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 218 00000100:00100000:1.0:1787602574.145090:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+61:11622:x1874436833767424:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787602574.145137:0:8208:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787602574.145299:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+61:11622:x1874436833767424:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 211us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602574.145309:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 218 00000100:00100000:3.0:1787602574.151323:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602574.151436:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833767680 00000100:00100000:2.0:1787602574.151473:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833767680 00000100:00100000:2.0:1787602574.151558:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 219 00000100:00100000:2.0:1787602574.151579:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+61:11622:x1874436833767680:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602574.151606:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602574.151610:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787602574.151656:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dc049 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26c7 expref: 61 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.151687:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:2.0:1787602574.151695:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787602574.151714:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dc0b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c26ea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787602574.152324:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787602574.152599:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dc0c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.152616:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dc0c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.152629:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dc0c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.152697:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dc0b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ea expref: 63 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.152717:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dc0c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ea expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.152773:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3504d95a00) 00010000:00010000:2.0:1787602574.152776:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602574.152780:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4600, rc 0) 00000100:00100000:2.0:1787602574.152871:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+62:11622:x1874436833767680:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 1294us (1562us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787602574.152881:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 219 00000100:00100000:3.0:1787602574.156915:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602574.157090:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833767936 00000100:00100000:1.0:1787602574.157120:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833767936 00000100:00100000:1.0:1787602574.157207:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 220 00000100:00100000:1.0:1787602574.157220:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+62:11622:x1874436833767936:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787602574.157721:0:8208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602574.158855:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4600/0x3640686da09dc0c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ea expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.158888:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3504d95a00) 00010000:00010000:1.0:1787602574.158905:0:8208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602574.158939:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc0ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.158957:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc0ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.158968:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc0ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.158985:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc0d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd1a088ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.158992:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc0d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd1a088ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.158999:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc0d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd1a088ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.159096:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc0ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.159105:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc0ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.159126:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc0ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.159134:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eaa00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602574.159139:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc0ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.159148:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc0ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.159170:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:1.0:1787602574.159174:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602574.159178:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc0ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.159185:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc0ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.159197:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc0d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd1a088ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.159202:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc0d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd1a088ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.159208:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc0d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd1a088ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.159213:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602574.159216:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc0d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd1a088ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.159232:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc0d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd1a088ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.159241:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd1a088ab (ffff8d350cd81500) 00010000:00010000:1.0:1787602574.159243:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602574.159247:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc0d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd1a088ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.159253:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc0d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd1a088ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602574.159517:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+61:11622:x1874436833767936:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 2295us (2768us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787602574.159528:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 220 00000100:00100000:0.0:1787602574.171058:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602574.174435:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833768064 00000100:00100000:2.0:1787602574.174460:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833768064 00000100:00100000:2.0:1787602574.174631:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 221 00000100:00100000:2.0:1787602574.174651:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+61:11622:x1874436833768064:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602574.174679:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602574.174712:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dc0dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c26f1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.174780:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc0e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.174798:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.174812:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.174953:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dc0dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f1 expref: 63 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.174974:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc0e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f1 expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.174994:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3504d95e00) 00010000:00010000:2.0:1787602574.174997:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787602574.175001:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4e00, rc 0) 00000100:00100000:2.0:1787602574.175105:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+62:11622:x1874436833768064:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 463us (4063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602574.175113:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 221 00000100:00100000:0.0:1787602574.184046:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602574.184924:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833768320 00000100:00100000:2.0:1787602574.184942:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833768320 00000100:00100000:2.0:1787602574.185028:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 222 00000100:00100000:2.0:1787602574.185040:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+62:11622:x1874436833768320:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787602574.185189:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.185213:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.185228:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787602574.185605:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1787602574.185619:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359131874420ns, next at 360131871030ns, rc = 0 00000004:00010000:2.0:1787602574.185913:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ff0d9a5 reply state 0000000083ad864b transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602574.185926:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787602574.186085:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+64:11622:x1874436833768320:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 1045us (2051us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787602574.186115:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 222 00010000:00010000:0.0:1787602574.200001:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.200023:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.200054:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.200061:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602574.200067:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.200076:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.200097:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3504d95e00) 00010000:00010000:0.0:1787602574.200101:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787602574.200106:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.200112:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4c00/0x3640686da09dc0ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602574.201688:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602574.203368:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833768448 00000100:00100000:3.0:1787602574.203387:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833768448 00000100:00100000:3.0:1787602574.203555:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 223 00000100:00100000:3.0:1787602574.203579:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+63:11622:x1874436833768448:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787602574.203612:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602574.203639:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc0f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c26f8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.204576:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc0f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f8 expref: 64 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.204594:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc0f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f8 expref: 64 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.204621:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3504d95e00) 00010000:00010000:3.0:1787602574.204625:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602574.204630:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433e00, rc 0) 00000100:00100000:3.0:1787602574.204952:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+64:11622:x1874436833768448:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 1375us (3276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602574.204961:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 223 00000100:00100000:0.0:1787602574.216540:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602574.216951:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833768576 00000100:00100000:1.0:1787602574.216967:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833768576 00000100:00100000:1.0:1787602574.217069:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00100000:1.0:1787602574.217082:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d34074c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+9:2352:x1874436833768576:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787602574.217612:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d34074c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+10:2352:x1874436833768576:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 530us (1085us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787602574.217621:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00080000:3.0:1787602574.218469:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602574.222533:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602574.222675:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833768832 00000100:00100000:1.0:1787602574.222690:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833768832 00000100:00100000:1.0:1787602574.222807:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:1.0:1787602574.222823:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+64:11622:x1874436833768832:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787602574.223233:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+65:11622:x1874436833768832:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 403us (710us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787602574.223250:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:0.0:1787602574.229945:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602574.230080:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833769088 00000100:00100000:2.0:1787602574.230094:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833769088 00000100:00100000:2.0:1787602574.230183:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 224 00000100:00100000:2.0:1787602574.230196:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+65:11622:x1874436833769088:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787602574.230414:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+65:11622:x1874436833769088:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 219us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602574.230423:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 224 00000100:00100000:0.0:1787602574.237441:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602574.237529:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833769216 00000100:00100000:2.0:1787602574.237545:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833769216 00000100:00100000:2.0:1787602574.237629:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 225 00000100:00100000:2.0:1787602574.237643:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+65:11622:x1874436833769216:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602574.237671:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602574.237700:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dc0f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c26ff expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.237849:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dc0ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.237867:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dc0ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.237880:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dc0ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602574.237931:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602574.237954:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dc0ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.238003:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5200/0x3640686da09dc0f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ff expref: 67 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.238024:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dc0ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ff expref: 66 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.238034:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3504d95e00) 00010000:00010000:2.0:1787602574.238037:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787602574.238042:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5400, rc 0) 00000100:00100000:2.0:1787602574.238119:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+66:11622:x1874436833769216:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 479us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602574.238126:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 225 00000100:00100000:1.0:1787602574.242699:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602574.242988:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833769344 00000100:00100000:0.0:1787602574.243002:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833769344 00000100:00100000:0.0:1787602574.243073:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00100000:0.0:1787602574.243085:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+10:2351:x1874436833769344:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602574.243111:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602574.243141:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dc106 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2706 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787602574.243212:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8ca68f, blocks: 0x1 00010000:00010000:0.0:1787602574.243238:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=359s v=(0 0) 00010000:00010000:0.0:1787602574.243244:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602574.243257:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dc106 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2706 expref: 11 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.243281:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dc106 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2706 expref: 11 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.243298:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2a00, rc 0) 00000100:00100000:0.0:1787602574.243383:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+11:2351:x1874436833769344:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 299us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602574.243390:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00100000:0.0:1787602574.254183:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602574.254269:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833769600 00000100:00100000:1.0:1787602574.254284:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833769600 00000100:00100000:1.0:1787602574.254364:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 226 00000100:00100000:1.0:1787602574.254377:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+66:11622:x1874436833769600:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787602574.254547:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+66:11622:x1874436833769600:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 172us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602574.254556:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 226 00000100:00100000:3.0:1787602574.257304:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602574.257643:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833769728 00000100:00100000:0.0:1787602574.257655:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833769728 00000100:00100000:0.0:1787602574.257729:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 66 00000100:00100000:0.0:1787602574.257797:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+11:11622:x1874436833769728:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602574.257823:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602574.257849:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd2cbf8b/0x3640686da09dc10d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c270d expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.257890:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dc106 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2706 expref: 12 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.257923:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602574.257928:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602574.257934:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd2cbf8b/0x3640686da09dc10d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c270d expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.257974:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dc106 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2706 expref: 12 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.257989:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dc106 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2706 expref: 12 pid: 6691 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602574.258003:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f02a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1874436853677952:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787602574.258112:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350855ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787602574.260548:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602574.263459:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833769856 00000100:00100000:2.0:1787602574.263478:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833769856 00010000:00010000:2.0:1787602574.263555:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dc106 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2706 expref: 13 pid: 6691 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602574.263629:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 82 00000100:00100000:2.0:1787602574.263642:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+13:2351:x1874436833769856:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602574.263663:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602574.263693:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dc106 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2706 expref: 13 pid: 6691 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.263711:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dc106 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2706 expref: 13 pid: 6691 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.263821:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602574.263827:0:11167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602574.263838:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd2cbf8b/0x3640686da09dc10d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c270d expref: 13 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.263850:0:11167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd2cbf8b/0x3640686da09dc10d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c270d expref: 13 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.263901:0:11167:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fd2cbf8b/0x3640686da09dc10d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c270d expref: 13 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602574.263917:0:11167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11167:1874436853678080:192.168.201.26@tcp:105: 00000100:00100000:2.0:1787602574.264025:0:11167:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350af32840 going to sleep for 11 seconds 00010000:00010000:0.0:1787602574.264369:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059c9a493/0x3640686da09dc106 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2706 expref: 13 pid: 6691 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602574.264395:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f02a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1874436853677952:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787602574.264426:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd2cbf8b/0x3640686da09dc10d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c270d expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.264452:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2800, rc 0) 00000100:00100000:0.0:1787602574.264503:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+12:11622:x1874436833769728:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 6763us (7212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602574.264525:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 66 00000100:00100000:2.0:1787602574.269577:0:11167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11167:1874436853678080:192.168.201.26@tcp:105: 00010000:00010000:2.0:1787602574.269614:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602574.269692:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+11:2351:x1874436833769856:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 6051us (9158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602574.269705:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 82 00000100:00100000:2.0:1787602574.280898:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602574.281048:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833769984 00000100:00100000:3.0:1787602574.281061:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833769984 00002000:00100000:3.0:1787602574.281134:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8d3534f7c000 x1874436833769984/t0(0) o4->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:410/0 lens 504/0 e 0 to 0 dl 1787602585 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787602574.281175:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3534f7c000 with x1874436833769984 ext(0->12) 00002000:00010000:3.0:1787602574.281183:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3534f7c000 00000100:00100000:3.0:1787602574.281219:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:3.0:1787602574.281231:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+11:2352:x1874436833769984:12345-192.168.201.26@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787602574.281877:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+13:2352:x1874436833769984:12345-192.168.201.26@tcp:4:lhsmtool_posix.0 Request processed in 645us (993us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787602574.281887:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 6 00002000:00100000:3.0:1787602574.281897:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8d3534f7c000 x1874436833769984/t4294967320(0) o4->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:410/0 lens 504/448 e 0 to 0 dl 1787602585 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787602574.281907:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d3534f7c000 with x1874436833769984 ext(0->12) 00002000:00010000:3.0:1787602574.281912:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d3534f7c000 00000100:00100000:3.0:1787602574.287687:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602574.287868:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833770112 00000100:00100000:0.0:1787602574.287884:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833770112 00000100:00100000:0.0:1787602574.287963:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 227 00000100:00100000:0.0:1787602574.287977:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+66:11622:x1874436833770112:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787602574.322684:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967494 is committed 00000004:00080000:1.0:1787602574.322702:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1787602574.322738:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d350887d480 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787602574.322765:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d350bb21c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d350887d300 00000020:00080000:1.0:1787602574.322769:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d350bb21000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d34041d4c00 00000004:00080000:1.0:1787602574.322785:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:1.0:1787602574.322800:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1787602574.322828:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:1.0:1787602574.322891:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d350af52840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787602574.322894:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d350342ce00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d350af52600 00000020:00080000:1.0:1787602574.322897:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d350342c400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d35354a4000 00000020:00080000:1.0:1787602574.322945:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787602574.323214:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787602574.323418:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853678208:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787602574.323593:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602574.323669:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853678336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787602574.323697:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602574.323768:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853678208 00000100:00100000:1.0:1787602574.323777:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853678208 00000100:00100000:1.0:1787602574.323835:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853678336 00000100:00100000:1.0:1787602574.323838:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853678336 00000100:00100000:1.0:1787602574.323858:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787602574.323867:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1874436853678208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787602574.323901:0:8625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1787602574.323934:0:8625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd1e0cf2/0x3640686da09dc114 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.323962:0:8625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004de81032/0x3640686da09dbed6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c266c expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.323973:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787602574.323978:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787602574.323983:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd1e0cf2/0x3640686da09dc114 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.324016:0:8625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004de81032/0x3640686da09dbed6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c266c expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.324032:0:8625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004de81032/0x3640686da09dbed6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c266c expref: 12 pid: 6689 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602574.324060:0:8625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c837480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1874436853678464:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602574.324137:0:8625:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350b948d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787602574.324169:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787602574.324178:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1874436853678336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787602574.324353:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787602574.324357:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787602575 00002000:00010000:1.0:1787602574.324360:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787602574.324362:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787602575 -> 1787602575 00002000:00010000:1.0:1787602574.324365:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787602574.324409:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3303:x1874436853678336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 232us (711us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787602574.324415:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787602574.324625:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+20:11622:x1874436833770112:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 Request processed in 36649us (36958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602574.324635:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 227 00000004:00080000:0.0:1787602574.325808:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d35351c7480/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787602574.325821:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853678336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787602574.325834:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787602574.325844:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853678592:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787602574.325895:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602574.325982:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853678592 00000100:00100000:3.0:1787602574.325990:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853678592 00000100:00100000:3.0:1787602574.326036:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787602574.326046:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874436853678592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787602574.326146:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1787602574.326202:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8ca68d, atime: 0x6a8ca68e, ctime: 0x6a8ca68d, blocks: 0x1 00010000:00010000:3.0:1787602574.326216:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac9201df/0x3640686da09dc11b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.326259:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1787602574.326264:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787602574.326272:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac9201df/0x3640686da09dc11b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.326292:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac9201df/0x3640686da09dc11b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.326305:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac9201df/0x3640686da09dc11b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.326314:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac9201df/0x3640686da09dc11b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.326345:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787602574.327206:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1874436853678592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1158us (1307us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787602574.327216:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1787602574.327265:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787602574.327365:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602574.327376:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac9201df/0x3640686da09dc11b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.327388:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433800 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602574.327395:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac9201df/0x3640686da09dc11b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.327408:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac9201df/0x3640686da09dc11b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.327435:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac9201df/0x3640686da09dc11b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.327444:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac9201df/0x3640686da09dc11b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.327481:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602574.327484:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602574.327486:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787602574.327529:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d3534f02a00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787602574.327537:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853678592:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787602574.333243:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602574.333414:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833770240 00000100:00100000:3.0:1787602574.333427:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833770240 00000100:00100000:3.0:1787602574.333498:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 70 00000100:00100000:3.0:1787602574.333510:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+13:2351:x1874436833770240:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787602574.334523:0:8625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c837480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1874436853678464:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602574.334573:0:8625:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bd1e0cf2/0x3640686da09dc114 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602574.340051:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602574.340120:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833770368 00000100:00100000:3.0:1787602574.340136:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833770368 00010000:00010000:3.0:1787602574.340199:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004de81032/0x3640686da09dbed6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c266c expref: 14 pid: 6689 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602574.340282:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 83 00000100:00100000:3.0:1787602574.340294:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+14:2351:x1874436833770368:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602574.340317:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602574.340324:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004de81032/0x3640686da09dbed6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c266c expref: 14 pid: 6689 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.340340:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004de81032/0x3640686da09dbed6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c266c expref: 14 pid: 6689 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.340368:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004de81032/0x3640686da09dbed6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c266c expref: 14 pid: 6689 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.340388:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787602574.340393:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787602574.340401:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd1e0cf2/0x3640686da09dc114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.340413:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd1e0cf2/0x3640686da09dc114 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.340447:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602574.340521:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+13:2351:x1874436833770368:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 228us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602574.340530:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 83 00010000:00010000:1.0:1787602574.341385:0:8625:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bd1e0cf2/0x3640686da09dc114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.341400:0:8625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd1e0cf2/0x3640686da09dc114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.341413:0:8625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd1e0cf2/0x3640686da09dc114 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.341430:0:8625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd1e0cf2/0x3640686da09dc114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.341457:0:8625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602574.341660:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602574.341671:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd1e0cf2/0x3640686da09dc114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.341695:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eae00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602574.341700:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd1e0cf2/0x3640686da09dc114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.341711:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd1e0cf2/0x3640686da09dc114 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.341731:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd1e0cf2/0x3640686da09dc114 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.341738:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd1e0cf2/0x3640686da09dc114 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.341791:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602574.341793:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602574.341795:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602574.343008:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3302:x1874436853678208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19132us (19405us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1787602574.343023:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1787602574.343229:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d35351c4e00/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787602574.343244:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853678208:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1787602574.373049:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1787602574.373074:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:0.0:1787602574.373087:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:3.0:1787602574.373389:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534976a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833770240:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 Request processed in 39869us (40151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602574.373406:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 70 00000100:00100000:2.0:1787602574.377880:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602574.378880:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833770624 00000100:00100000:1.0:1787602574.378953:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833770624 00000100:00100000:1.0:1787602574.379081:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 228 00000100:00100000:1.0:1787602574.379094:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+20:11622:x1874436833770624:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787602574.379180:0:8208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602574.379223:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5400/0x3640686da09dc0ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26ff expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.379250:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3504d95e00) 00010000:00010000:1.0:1787602574.379257:0:8208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602574.379301:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc122 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.379317:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.379330:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602574.381515:0:8208:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052385510 reply state 000000009c87c79a transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602574.381560:0:8208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787602574.384763:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+21:11622:x1874436833770624:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 5640us (6866us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787602574.384778:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 228 00010000:00010000:1.0:1787602574.389780:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.389803:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc122 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.389813:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc122 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.389820:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602574.389826:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc122 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.389836:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc122 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.389859:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3504d95e00) 00010000:00010000:1.0:1787602574.389864:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602574.389870:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc122 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.389877:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ea200/0x3640686da09dc122 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602574.390325:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602574.390423:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833770752 00000100:00100000:1.0:1787602574.390437:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833770752 00000100:00100000:1.0:1787602574.390558:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 71 00000100:00100000:1.0:1787602574.390571:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833770752:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787602574.390925:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787602574.390929:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787602575 -> 1787602574 00002000:00010000:1.0:1787602574.390932:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787602574 00002000:00010000:1.0:1787602574.390934:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787602575 -> 1787602574 00002000:00010000:1.0:1787602574.390937:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787602574.391011:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2351:x1874436833770752:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 440us (691us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787602574.391020:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 71 00000100:00100000:3.0:1787602574.392838:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602574.392962:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833771008 00000100:00100000:2.0:1787602574.392974:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833771008 00000100:00100000:2.0:1787602574.393032:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 229 00000100:00100000:2.0:1787602574.393043:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d01aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+20:11622:x1874436833771008:12345-192.168.201.26@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787602574.393260:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc129 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.393303:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc0e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f1 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.393315:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc129 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.393359:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc0e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f1 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.393376:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc0e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f1 expref: 20 pid: 5836 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602574.393393:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853678720:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602574.393556:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a4e93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602574.395569:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602574.395695:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874436853678720:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602574.395723:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc129 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602574.396022:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833771136 00000100:00100000:1.0:1787602574.396031:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833771136 00010000:00010000:0.0:1787602574.396161:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc0e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f1 expref: 21 pid: 5836 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602574.396241:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 84 00000100:00100000:0.0:1787602574.396253:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+21:2352:x1874436833771136:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602574.396271:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602574.396280:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc0e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f1 expref: 21 pid: 5836 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.396294:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc0e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f1 expref: 21 pid: 5836 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.396320:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc0e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f1 expref: 21 pid: 5836 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.396338:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3504d95e00) 00010000:00010000:0.0:1787602574.396361:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc129 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.396372:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.396380:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc129 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.396412:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602574.396479:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+20:2352:x1874436833771136:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 228us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602574.396488:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 84 00010000:00010000:3.0:1787602574.397144:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.397165:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.397201:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.397209:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc129 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.397217:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc129 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.397323:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602574.397329:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc129 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.397338:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc129 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.397352:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3504d95e00) 00010000:00010000:3.0:1787602574.397355:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787602574.397359:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc129 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.397380:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc129 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602574.397503:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d01aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+19:11622:x1874436833771008:12345-192.168.201.26@tcp:55:lhsmtool_posix.0 Request processed in 4459us (4673us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787602574.397514:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 229 00000100:00100000:0.0:1787602574.403720:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602574.403912:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833771264 00000100:00100000:1.0:1787602574.403925:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833771264 00000100:00100000:1.0:1787602574.404097:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 72 00000100:00100000:1.0:1787602574.404109:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2353:x1874436833771264:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787602574.404178:0:8625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a613c177/0x3640686da09dc130 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.404204:0:8625:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd2cbf8b/0x3640686da09dc10d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c270d expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.404215:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602574.404220:0:8625:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787602574.404226:0:8625:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a613c177/0x3640686da09dc130 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.404311:0:8625:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd2cbf8b/0x3640686da09dc10d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c270d expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.404329:0:8625:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd2cbf8b/0x3640686da09dc10d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c270d expref: 8 pid: 6690 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602574.404347:0:8625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c837480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1874436853678848:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602574.404561:0:8625:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3536ba6240 going to sleep for 11 seconds 00000100:00100000:2.0:1787602574.408010:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602574.408101:0:8625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c837480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8625:1874436853678848:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787602574.408114:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833771392 00000100:00100000:3.0:1787602574.408123:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833771392 00010000:00010000:1.0:1787602574.408137:0:8625:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a613c177/0x3640686da09dc130 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.408202:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd2cbf8b/0x3640686da09dc10d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c270d expref: 9 pid: 6690 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602574.408290:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 85 00000100:00100000:2.0:1787602574.408306:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+9:2352:x1874436833771392:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602574.408326:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602574.408358:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd2cbf8b/0x3640686da09dc10d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c270d expref: 9 pid: 6690 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.408373:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd2cbf8b/0x3640686da09dc10d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c270d expref: 9 pid: 6690 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.408419:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd2cbf8b/0x3640686da09dc10d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c270d expref: 9 pid: 6690 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.408445:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602574.408451:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602574.408458:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a613c177/0x3640686da09dc130 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.408469:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a613c177/0x3640686da09dc130 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.408513:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602574.408576:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2352:x1874436833771392:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 273us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602574.408584:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 85 00010000:00010000:1.0:1787602574.408712:0:8625:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a613c177/0x3640686da09dc130 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.408722:0:8625:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a613c177/0x3640686da09dc130 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.408793:0:8625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a613c177/0x3640686da09dc130 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.408803:0:8625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a613c177/0x3640686da09dc130 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.408824:0:8625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a613c177/0x3640686da09dc130 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.408834:0:8625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea200 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602574.408839:0:8625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a613c177/0x3640686da09dc130 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.408848:0:8625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a613c177/0x3640686da09dc130 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.408862:0:8625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a613c177/0x3640686da09dc130 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602574.408869:0:8625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a613c177/0x3640686da09dc130 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602574.408923:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2353:x1874436833771264:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 Request processed in 4816us (5281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602574.408931:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 72 00000100:00100000:2.0:1787602574.410999:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602574.411093:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833771648 00000100:00100000:0.0:1787602574.411104:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833771648 00000100:00100000:0.0:1787602574.411203:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 230 00000100:00100000:0.0:1787602574.411214:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+19:11622:x1874436833771648:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787602574.411403:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09dc137 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.411425:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09dc137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.411438:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09dc137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.411853:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09dc13e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.411867:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc0f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f8 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.411890:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09dc13e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.411937:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc0f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f8 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602574.411954:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc0f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f8 expref: 20 pid: 5837 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602574.412048:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874436853678976:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787602574.412200:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503365480 going to sleep for 11 seconds 00000100:00100000:0.0:1787602574.415103:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602574.415192:0:11167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833771776 00000100:00100000:3.0:1787602574.415204:0:11167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833771776 00010000:00010000:3.0:1787602574.415269:0:11167:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc0f1 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f8 expref: 21 pid: 5837 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602574.415346:0:11167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 86 00000100:00100000:3.0:1787602574.415358:0:11167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+21:2352:x1874436833771776:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602574.415376:0:11167:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602574.415384:0:11167:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc0f1 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f8 expref: 21 pid: 5837 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.415400:0:11167:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc0f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f8 expref: 21 pid: 5837 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.415427:0:11167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3504d95e00) 00010000:00010000:3.0:1787602574.415434:0:11167:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09dc13e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.415465:0:11167:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09dc13e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.415474:0:11167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09dc13e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.415506:0:11167:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602574.415765:0:11167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+21:2352:x1874436833771776:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 384us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602574.415773:0:11167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 86 00010000:00010000:2.0:1787602574.415868:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc0f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26f8 expref: 20 pid: 5837 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602574.415887:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874436853678976:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602574.415925:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09dc13e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.415937:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09dc13e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.415960:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09dc13e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602574.416229:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1787602574.416403:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787602574.416447:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787602574.416955:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5838:1874436853679104:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787602574.417030:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602574.417080:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3502ff5780 going to sleep for 11 seconds 00000100:00100000:1.0:1787602574.417112:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853679104 00000100:00100000:1.0:1787602574.417121:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853679104 00000100:00100000:1.0:1787602574.417184:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787602574.417195:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5838:x1874436853679104:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787602574.417298:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5838:x1874436853679104:12345-0@lo:1000:mdt00_002.0 Request processed in 105us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602574.417323:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787602574.417738:0:5838:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1787602574.417767:0:5838:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1787602574.417797:0:5838:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d35351c7480, transno 4294967321 00000100:00100000:2.0:1787602574.417822:0:5838:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8d35351c4e00 x1874436853678208/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787602590 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602574.417836:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5838:1874436853679104:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787602574.418680:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787602574.418789:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5838:1874436853679232:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787602574.418849:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602574.418880:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787602574.419352:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853679232 00000100:00100000:1.0:1787602574.419361:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853679232 00000100:00100000:1.0:1787602574.419409:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787602574.419421:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5838:x1874436853679232:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787602574.419717:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5838:x1874436853679232:12345-0@lo:1000:mdt00_002.0 Request processed in 297us (866us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787602574.419726:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787602574.419854:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5838:1874436853679232:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787602574.419910:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09dc13e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.419923:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09dc13e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.419931:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09dc13e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.419951:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e2400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602574.419956:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09dc13e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.419965:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09dc13e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.419985:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3504d95e00) 00010000:00010000:2.0:1787602574.419988:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602574.419994:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09dc13e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.420001:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2400/0x3640686da09dc13e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.420039:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc081 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.420044:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc081 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.420051:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc081 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.420056:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602574.420058:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc081 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.420063:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc081 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.420082:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:2.0:1787602574.420085:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787602574.420093:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dc088 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26dc expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.420106:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dc088 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26dc expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.420116:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dc088 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26dc expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.420160:0:5838:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dc088 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26dc expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602574.420174:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874436853679360:192.168.201.26@tcp:105: 00000100:00100000:2.0:1787602574.420271:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787602574.423002:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602574.423417:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833771904 00000100:00100000:3.0:1787602574.423429:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833771904 00000100:00100000:3.0:1787602574.423508:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:3.0:1787602574.423519:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+24:11621:x1874436833771904:12345-192.168.201.26@tcp:49:lfs.0 00000100:00100000:3.0:1787602574.423912:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+24:11621:x1874436833771904:12345-192.168.201.26@tcp:49:lfs.0 Request processed in 385us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602574.423921:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:2.0:1787602574.425454:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874436853679360:192.168.201.26@tcp:105: 00010000:00010000:2.0:1787602574.425504:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc081 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425516:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc081 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425683:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc145 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425703:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc145 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425758:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc145 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425772:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc145 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425779:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc145 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425786:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc145 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425792:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602574.425797:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc145 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425805:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc145 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425819:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:2.0:1787602574.425823:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602574.425829:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc145 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425835:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc145 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425845:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09dc137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425851:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09dc137 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425864:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09dc137 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425869:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602574.425873:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09dc137 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425880:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09dc137 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425889:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:2.0:1787602574.425892:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787602574.425895:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09dc137 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.425912:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3a00/0x3640686da09dc137 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602574.426371:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602574.426534:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833772160 00000100:00100000:1.0:1787602574.426544:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833772160 00000100:00100000:1.0:1787602574.426613:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 231 00000100:00100000:1.0:1787602574.426623:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3503e4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+24:11621:x1874436833772160:12345-192.168.201.26@tcp:58:lfs.0 00000040:00080000:1.0:1787602574.427039:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787602574.427129:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3503e4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+24:11621:x1874436833772160:12345-192.168.201.26@tcp:58:lfs.0 Request processed in 507us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602574.427138:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 231 00000100:00100000:2.0:1787602574.427514:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+23:11622:x1874436833771648:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 16300us (16524us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787602574.427524:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 230 00000020:00080000:2.0:1787602574.427531:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787602574.428703:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787602574.428711:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602574.429014:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787602574.429023:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787602574.429174:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d102680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874436853679488:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787602574.429370:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3536ba6180 going to sleep for 11 seconds 00000100:00100000:1.0:1787602574.443820:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602574.444034:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d102680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1874436853679488:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787602574.444329:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833772416 00000100:00100000:0.0:1787602574.444339:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833772416 00000100:00100000:0.0:1787602574.444411:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 62 00000100:00100000:0.0:1787602574.444424:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3527f63050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+23:11622:x1874436833772416:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787602574.444890:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602574.445044:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833772544 00000100:00100000:2.0:1787602574.445051:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833772544 00000100:00100000:2.0:1787602574.445100:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 232 00000100:00100000:2.0:1787602574.445110:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+25:11623:x1874436833772544:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787602574.445137:0:8208:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787602574.445298:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+25:11623:x1874436833772544:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 189us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602574.445307:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 232 00000004:00080000:2.0:1787602574.450600:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787602574.450815:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1787602574.450938:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc14c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.450961:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc14c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.450976:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc14c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.450988:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc14c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.450995:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc14c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.451002:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc14c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.451045:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787602574.451222:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3527f63050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+25:11622:x1874436833772416:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 6792us (7412us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1787602574.451234:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 62 00010000:00010000:3.0:1787602574.451236:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:2.0:1787602574.451241:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787602574.451245:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc14c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.451253:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4e00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:3.0:1787602574.451259:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc14c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.451267:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc14c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.451298:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d3504d95e00) 00010000:00010000:3.0:1787602574.451300:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787602574.451307:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc14c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.451311:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4e00/0x3640686da09dc14c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.451332:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602574.451334:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602574.451335:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602574.451546:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602574.455276:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833772800 00000100:00100000:2.0:1787602574.455303:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833772800 00000100:00100000:2.0:1787602574.455424:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 233 00000100:00100000:2.0:1787602574.455460:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+25:11623:x1874436833772800:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602574.455491:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602574.455521:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc153 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2714 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.455676:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09dc15a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.455696:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09dc15a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.455711:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09dc15a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602574.455725:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787602574.455968:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc153 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2714 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.455996:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09dc15a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2714 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.456007:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:2.0:1787602574.456011:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787602574.456016:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4000, rc 0) 00000100:00100000:2.0:1787602574.456122:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+27:11623:x1874436833772800:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 665us (4578us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787602574.456129:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 233 00000100:00100000:1.0:1787602574.462218:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602574.462280:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602574.462378:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833773056 00000100:00100000:3.0:1787602574.462393:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833773056 00000100:00100000:2.0:1787602574.462443:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833773184 00000100:00100000:2.0:1787602574.462448:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833773184 00000100:00100000:3.0:1787602574.462472:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 234 00000100:00100000:3.0:1787602574.462494:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+28:11623:x1874436833773056:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787602574.462614:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc168 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.462776:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc168 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.462793:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc168 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.463104:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc168 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.463112:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc168 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.463134:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc168 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.463141:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602574.463155:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc168 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.463165:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc168 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.463180:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:3.0:1787602574.463184:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787602574.463189:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc168 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.463196:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc168 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602574.463776:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 235 00000100:00100000:2.0:1787602574.463792:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+29:11625:x1874436833773184:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787602574.463813:0:8208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602574.463836:0:8208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc16f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c271b expref: -99 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.463899:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc176 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.463910:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.463918:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602574.463927:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d100e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+30:11623:x1874436833773056:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 1444us (1725us total) trans 4294967516 rc 0/0 00010000:00010000:2.0:1787602574.463933:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dc17d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602574.463937:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 234 00010000:00010000:2.0:1787602574.463939:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dc17d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.463945:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dc17d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.465319:0:8208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dc184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.465345:0:8208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26d5 expref: 29 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.465356:0:8208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dc184 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.465418:0:8208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26d5 expref: 29 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.465439:0:8208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26d5 expref: 29 pid: 8208 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602574.465460:0:8208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853679616:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602574.465834:0:8208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a4e9c00 going to sleep for 11 seconds 00000040:00080000:2.0:1787602574.465977:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787602574.465982:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787602574.467455:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787602574.467474:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787602574.469441:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602574.469679:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833773440 00000100:00100000:1.0:1787602574.469693:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833773440 00000100:00100000:1.0:1787602574.469787:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 63 00000100:00100000:1.0:1787602574.469801:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+30:6052:x1874436833773440:12345-192.168.201.26@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787602574.470137:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+31:6052:x1874436833773440:12345-192.168.201.26@tcp:35:ldlm_bl.0 Request processed in 339us (707us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787602574.470157:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 63 00000100:00100000:3.0:1787602574.470229:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602574.470333:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833773696 00000100:00100000:1.0:1787602574.470338:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833773696 00000100:00100000:1.0:1787602574.470373:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00100000:1.0:1787602574.470381:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+31:11623:x1874436833773696:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787602574.470495:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+32:11623:x1874436833773696:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 114us (279us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787602574.470503:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 64 00000100:00100000:2.0:1787602574.470733:0:8208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8208:1874436853679616:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602574.470856:0:8208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dc184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602574.472504:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602574.472648:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833773824 00000100:00100000:2.0:1787602574.472658:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833773824 00010000:00010000:2.0:1787602574.472703:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26d5 expref: 32 pid: 8208 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602574.472790:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 87 00000100:00100000:3.0:1787602574.472803:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3509d55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+32:2352:x1874436833773824:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602574.472820:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602574.472828:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26d5 expref: 32 pid: 8208 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.472862:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26d5 expref: 32 pid: 8208 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.472894:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3400/0x3640686da09dc073 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26d5 expref: 32 pid: 8208 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.472913:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:3.0:1787602574.472919:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dc184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.472931:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dc184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.472940:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dc184 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602574.472974:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602574.473038:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3509d55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+31:2352:x1874436833773824:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 238us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602574.473045:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 87 00010000:00010000:2.0:1787602574.473480:0:8208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dc184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473490:0:8208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dc184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602574.473570:0:8208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787602574.473586:0:8208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602574.473616:0:8208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dc184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473634:0:8208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dc184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473645:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473653:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc176 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473661:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc176 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473669:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602574.473675:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc176 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473684:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc176 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473696:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:2.0:1787602574.473700:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602574.473704:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc176 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473711:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5000/0x3640686da09dc176 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473725:0:8208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dc17d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473779:0:8208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dc17d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473786:0:8208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dc17d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473792:0:8208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602574.473796:0:8208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dc17d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473803:0:8208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dc17d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473812:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d3504d95700) 00010000:00010000:2.0:1787602574.473816:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602574.473819:0:8208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dc17d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473825:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5e00/0x3640686da09dc17d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473873:0:8208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4200/0x3640686da09dc16f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c271b expref: 31 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473888:0:8208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dc184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c271b expref: 30 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602574.473896:0:8208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:2.0:1787602574.473898:0:8208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602574.473908:0:8208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4a00, rc 0) 00000100:00100000:2.0:1787602574.473953:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+30:11625:x1874436833773184:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 10166us (11672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602574.473962:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 235 00000100:00100000:1.0:1787602574.967263:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853679744:0@lo:400:kworker.0 00000100:00100000:1.0:1787602574.967357:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602574.967422:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602574.967427:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853679872:0@lo:400:kworker.0 00000100:00100000:1.0:1787602574.967457:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602574.967490:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853680000:0@lo:400:kworker.0 00000100:00100000:1.0:1787602574.967513:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602574.967528:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787602574.967532:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853680128:0@lo:400:kworker.0 00000100:00100000:1.0:1787602574.967551:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602574.967600:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853679744 00000100:00100000:1.0:1787602574.967628:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853679744 00000100:00100000:1.0:1787602574.967686:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787602574.967696:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853679744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602574.967783:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853679744:12345-0@lo:400:kworker.0 Request processed in 87us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602574.967791:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787602574.967827:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853679872 00000100:00100000:1.0:1787602574.967831:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853679872 00000100:00100000:1.0:1787602574.967856:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853680000 00000100:00100000:1.0:1787602574.967858:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853680000 00000100:00100000:1.0:1787602574.967882:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853680128 00000100:00100000:1.0:1787602574.967884:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853680128 00000100:00100000:1.0:1787602574.967898:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787602574.967903:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853679872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602574.967934:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853679872:12345-0@lo:400:kworker.0 Request processed in 31us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602574.967940:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787602574.967950:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787602574.967955:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853680000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602574.967978:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853680000:12345-0@lo:400:kworker.0 Request processed in 23us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602574.967984:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787602574.967993:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787602574.967998:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853680128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602574.968023:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853680128:12345-0@lo:400:kworker.0 Request processed in 25us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602574.968029:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1787602574.968052:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602574.968084:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853679872:0@lo:400:kworker.0 00000100:00100000:1.0:1787602574.968093:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853679744:0@lo:400:kworker.0 00000100:00100000:1.0:1787602574.968117:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853680128:0@lo:400:kworker.0 00000100:00100000:1.0:1787602574.968125:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853680000:0@lo:400:kworker.0 00010000:00010000:1.0:1787602575.021202:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787602575.339950:0:12613:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787602575.339966:0:12613:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787602575.340047:0:12613:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787602575.340054:0:12613:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787602575.470497:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853680256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602575.470610:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602575.473392:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853680256 00000100:00100000:0.0:1787602575.473413:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853680256 00000100:00100000:0.0:1787602575.473623:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787602575.473638:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874436853680256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787602575.473699:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602575.473845:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874436853680256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 211us (3235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602575.473853:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787602575.473916:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853680256:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787602575.476970:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602575.533611:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602575.533662:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833774080 00000100:00100000:3.0:1787602575.533676:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833774080 00000100:00100000:3.0:1787602575.533768:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 236 00000100:00100000:3.0:1787602575.533777:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+30:11648:x1874436833774080:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602575.533813:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602575.533840:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc18b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2722 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602575.533970:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc192 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602575.533986:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc192 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602575.534002:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc192 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602575.534016:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787602575.534226:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc18b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2722 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602575.534244:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc192 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2722 expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602575.534252:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:3.0:1787602575.534255:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787602575.534258:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432400, rc 0) 00000100:00100000:3.0:1787602575.534330:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+32:11648:x1874436833774080:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 555us (736us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787602575.534336:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 236 00000100:00100000:0.0:1787602575.544091:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602575.544156:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833774208 00000100:00100000:0.0:1787602575.544170:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833774208 00000100:00100000:0.0:1787602575.544242:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 237 00000100:00100000:0.0:1787602575.544256:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+32:11648:x1874436833774208:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:0.0:1787602575.544353:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dc1a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602575.544375:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dc1a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602575.544391:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dc1a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602575.544423:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dc1a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602575.544430:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dc1a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602575.544438:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dc1a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602575.544445:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602575.544450:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dc1a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602575.544468:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dc1a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602575.544484:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:0.0:1787602575.544488:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602575.544494:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dc1a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602575.544501:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3200/0x3640686da09dc1a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602575.544599:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+32:11648:x1874436833774208:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 346us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602575.544607:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 237 00000100:00100000:3.0:1787602575.573914:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602575.573974:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602575.573996:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602575.574036:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602575.574318:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833774592 00000100:00100000:1.0:1787602575.574331:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833774592 00000100:00100000:1.0:1787602575.574412:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833774464 00000100:00100000:1.0:1787602575.574415:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833774464 00000100:00100000:1.0:1787602575.574444:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 98 00000100:00100000:1.0:1787602575.574470:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833774592:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602575.574585:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833774592:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 130us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602575.574594:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 98 00000100:00100000:1.0:1787602575.574615:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 99 00000100:00100000:1.0:1787602575.574623:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833774464:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602575.574655:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833774464:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 33us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602575.574661:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 99 00000100:00080000:1.0:1787602575.574680:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602575.577446:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833774336 00000100:00100000:3.0:1787602575.577476:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833774336 00000100:00100000:3.0:1787602575.577549:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 302 00000100:00100000:3.0:1787602575.577562:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2351:x1874436833774336:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602575.577663:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2351:x1874436833774336:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 104us (3766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602575.577672:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 302 00000100:00100000:3.0:1787602575.577724:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833774720 00000100:00100000:3.0:1787602575.577729:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833774720 00000100:00100000:3.0:1787602575.577799:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 170 00000100:00100000:3.0:1787602575.577806:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2351:x1874436833774720:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602575.577843:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2351:x1874436833774720:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 37us (3807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602575.577850:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 170 00000100:00080000:1.0:1787602575.582707:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787602575.639217:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602575.639362:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833774848 00000100:00100000:1.0:1787602575.639378:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833774848 00000100:00100000:1.0:1787602575.639467:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 73 00000100:00100000:1.0:1787602575.639499:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2351:x1874436833774848:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:1.0:1787602575.639525:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602575.639553:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005510df02/0x3640686da09dc1a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2729 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787602575.639594:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8ca68e, atime: 0x6a8ca68e, ctime: 0x6a8ca68e, blocks: 0xb 00010000:00010000:1.0:1787602575.639624:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=360s v=(0 0) 00010000:00010000:1.0:1787602575.639629:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602575.639642:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005510df02/0x3640686da09dc1a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2729 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602575.639666:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005510df02/0x3640686da09dc1a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2729 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602575.639684:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354ea800, rc 0) 00000100:00100000:1.0:1787602575.639817:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2351:x1874436833774848:12345-192.168.201.26@tcp:101:cat.0 Request processed in 319us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602575.639824:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 73 00000100:00100000:3.0:1787602575.644580:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602575.644729:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833774976 00000100:00100000:0.0:1787602575.644785:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833774976 00002000:00100000:0.0:1787602575.644859:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8d353d644a80 x1874436833774976/t0(0) o3->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:411/0 lens 488/0 e 0 to 0 dl 1787602586 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787602575.644873:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d353d644a80 with x1874436833774976 ext(0->4095) 00002000:00010000:0.0:1787602575.644880:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d353d644a80 00000100:00100000:0.0:1787602575.644922:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:0.0:1787602575.644934:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2352:x1874436833774976:12345-192.168.201.26@tcp:3:cat.0 00000100:00100000:0.0:1787602575.645246:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+8:2352:x1874436833774976:12345-192.168.201.26@tcp:3:cat.0 Request processed in 313us (680us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787602575.645255:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00002000:00100000:0.0:1787602575.645263:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8d353d644a80 x1874436833774976/t0(0) o3->e3aefeab-67b4-4a0a-9090-6916c4553638@192.168.201.26@tcp:411/0 lens 488/4536 e 0 to 0 dl 1787602586 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787602575.645284:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d353d644a80 with x1874436833774976 ext(0->4095) 00002000:00010000:0.0:1787602575.645287:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d353d644a80 00010000:00010000:2.0:1787602576.046405:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787602576.580139:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1787602576.580164:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1787602576.580172:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:2.0:1787602577.069038:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602577.518783:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853680384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602577.518892:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602577.519858:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853680384 00000100:00100000:0.0:1787602577.519871:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853680384 00000100:00100000:0.0:1787602577.519961:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787602577.519976:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874436853680384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602577.520031:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602577.520115:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874436853680384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602577.520123:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787602577.520197:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853680384:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787602577.520414:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787602578.093456:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602579.126734:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787602579.668375:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1787602579.668400:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1787602579.698916:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967513 is committed 00000001:00080000:1.0:1787602579.698955:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:1.0:1787602579.698973:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1787602579.699026:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d350343f540 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787602579.699033:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3534efd700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d350343f900 00000020:00080000:1.0:1787602579.699073:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d3534efda00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d3535674c00 00000001:00080000:1.0:1787602579.699094:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1787602579.699177:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787602579.699493:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1787602580.077213:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602580.077251:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853680768:0@lo:400:kworker.0 00000100:00100000:0.0:1787602580.077338:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602580.077423:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853680768 00000100:00100000:0.0:1787602580.077434:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853680768 00000100:00100000:0.0:1787602580.077512:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787602580.077524:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853680768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602580.077585:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853680768:12345-0@lo:400:kworker.0 Request processed in 64us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602580.077592:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:0.0:1787602580.077618:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602580.077651:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853680768:0@lo:400:kworker.0 00000100:00100000:0.0:1787602580.077711:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853680896:0@lo:400:kworker.0 00000100:00100000:0.0:1787602580.077776:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602580.077960:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874436853680640:0@lo:400:kworker.0 00000100:00100000:2.0:1787602580.077992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602580.078011:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853681152:0@lo:400:kworker.0 00000100:00100000:2.0:1787602580.078034:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602580.078060:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787602580.078066:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853680512:0@lo:400:kworker.0 00000100:00100000:2.0:1787602580.078097:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602580.078119:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853681024:0@lo:400:kworker.0 00000100:00100000:2.0:1787602580.078142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602580.078171:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853680512 00000100:00100000:2.0:1787602580.078176:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853680512 00000100:00100000:2.0:1787602580.078206:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787602580.078214:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350493ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3304:x1874436853680512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602580.078253:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350493ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3304:x1874436853680512:12345-0@lo:400:kworker.0 Request processed in 40us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602580.078259:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787602580.078306:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853680512:0@lo:400:kworker.0 00000100:00100000:1.0:1787602580.078392:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853680896 00000100:00100000:1.0:1787602580.078397:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853680896 00000100:00100000:1.0:1787602580.078446:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853681152 00000100:00100000:1.0:1787602580.078449:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853681152 00000100:00100000:1.0:1787602580.078482:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787602580.078490:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853680896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602580.078533:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853680896:12345-0@lo:400:kworker.0 Request processed in 45us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602580.078541:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787602580.078555:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787602580.078561:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853681152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602580.078594:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853681152:12345-0@lo:400:kworker.0 Request processed in 33us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602580.078600:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787602580.078625:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787602580.078631:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1787602580.078649:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d3534f02a00, transno 4294967310 00000100:00100000:1.0:1787602580.078662:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d21ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853681152:0@lo:400:kworker.0 00000100:00100000:1.0:1787602580.079124:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787602580.079129:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d35351c4e00, transno 4294967322 00000004:00080000:1.0:1787602580.079141:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787602580.079156:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853680896:0@lo:400:kworker.0 00000100:00100000:3.0:1787602580.079504:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853680640 00000100:00100000:3.0:1787602580.079511:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853680640 00000100:00100000:3.0:1787602580.079557:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853681024 00000100:00100000:3.0:1787602580.079561:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853681024 00000100:00100000:3.0:1787602580.079583:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787602580.079592:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35351c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874436853680640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602580.079663:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35351c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874436853680640:12345-0@lo:400:kworker.0 Request processed in 73us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602580.079671:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787602580.079687:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787602580.079693:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853681024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602580.079722:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853681024:12345-0@lo:400:kworker.0 Request processed in 30us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602580.079728:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787602580.079814:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853681024:0@lo:400:kworker.0 00000100:00100000:3.0:1787602580.079827:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874436853680640:0@lo:400:kworker.0 00000100:00080000:2.0:1787602580.080394:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787602580.080401:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787602580.080404:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787602580.142262:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602580.590149:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853681280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602580.590256:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602580.590351:0:10486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853681280 00000100:00100000:2.0:1787602580.590360:0:10486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853681280 00000100:00100000:2.0:1787602580.590421:0:10486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787602580.590433:0:10486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853681280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787602580.590483:0:10486:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602580.592978:0:10486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853681280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2536us (2711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602580.592994:0:10486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787602580.593104:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853681280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602580.697623:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602580.697837:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833775104 00000100:00100000:2.0:1787602580.697853:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833775104 00000100:00100000:2.0:1787602580.697927:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 304 00000100:00100000:2.0:1787602580.697939:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833775104:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602580.698066:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2354:x1874436833775104:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 128us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602580.698075:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 304 00000100:00100000:1.0:1787602580.701479:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602580.701624:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602580.701666:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602580.701699:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602580.701912:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833775616 00000100:00100000:1.0:1787602580.701927:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833775616 00000100:00100000:1.0:1787602580.702008:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833775232 00000100:00100000:1.0:1787602580.702012:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833775232 00000100:00100000:1.0:1787602580.702039:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 174 00000100:00100000:1.0:1787602580.702062:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2354:x1874436833775616:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602580.702168:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2354:x1874436833775616:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 108us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602580.702179:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 174 00000100:00100000:1.0:1787602580.702203:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 175 00000100:00100000:1.0:1787602580.702210:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+19:2354:x1874436833775232:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602580.702239:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+19:2354:x1874436833775232:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 30us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602580.702246:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 175 00000100:00100000:1.0:1787602580.702265:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833775360 00000100:00100000:1.0:1787602580.702270:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833775360 00000100:00100000:1.0:1787602580.702303:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833775488 00000100:00100000:1.0:1787602580.702306:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833775488 00000100:00100000:1.0:1787602580.702330:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 102 00000100:00100000:1.0:1787602580.702337:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2354:x1874436833775360:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602580.702364:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2354:x1874436833775360:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 28us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602580.702371:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 102 00000100:00100000:1.0:1787602580.702382:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 103 00000100:00100000:1.0:1787602580.702401:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833775488:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602580.702435:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833775488:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 36us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602580.702441:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 103 00000100:00080000:1.0:1787602580.702459:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602580.702464:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602580.702467:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602580.900394:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602580.900701:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833775744 00000100:00100000:1.0:1787602580.900717:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833775744 00000100:00100000:2.0:1787602580.903135:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 238 00000100:00100000:2.0:1787602580.903161:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+19:11301:x1874436833775744:12345-192.168.201.26@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787602580.903313:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+19:11301:x1874436833775744:12345-192.168.201.26@tcp:60:lhsmtool_posix.0 Request processed in 164us (2934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602580.903339:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 238 00000100:00100000:1.0:1787602580.909642:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602580.909796:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833776000 00000100:00100000:3.0:1787602580.909811:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833776000 00000100:00100000:3.0:1787602580.909891:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00100000:3.0:1787602580.909903:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+19:11301:x1874436833776000:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787602580.910612:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3aefeab-67b4-4a0a-9090-6916c4553638+20:11301:x1874436833776000:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 707us (985us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787602580.910622:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 65 00000100:00100000:0.0:1787602581.142130:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602581.146199:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833776128 00000100:00100000:1.0:1787602581.146225:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833776128 00000100:00100000:1.0:1787602581.146566:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 239 00000100:00100000:1.0:1787602581.146586:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:12100:x1874436833776128:12345-192.168.201.26@tcp:101:lsof.0 00010000:00010000:1.0:1787602581.146623:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602581.146656:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dc1ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2730 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.146847:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc1b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.146867:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.146885:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602581.147246:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787602581.147252:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602581.147725:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.147839:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354ebe00/0x3640686da09dc1ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2730 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.147866:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc1b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2730 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602581.147877:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502900) 00010000:00010000:1.0:1787602581.147881:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602581.147886:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eaa00, rc 0) 00000100:00100000:1.0:1787602581.148005:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+6:12100:x1874436833776128:12345-192.168.201.26@tcp:101:lsof.0 Request processed in 1423us (5891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602581.150377:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 239 00010000:00010000:1.0:1787602581.164996:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787602581.613841:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787602581.613853:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602581.614208:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1787602581.614215:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787602582.189125:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602582.637139:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787602582.637175:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405fa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853681408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602582.637277:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602582.637645:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853681408 00000100:00100000:3.0:1787602582.637657:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853681408 00000100:00100000:3.0:1787602582.637801:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787602582.637816:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d65d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853681408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602582.637867:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602582.637930:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d65d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853681408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602582.637959:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1787602582.638177:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602582.638228:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405fa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853681408:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787602583.213260:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602584.236874:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787602584.494150:0:12816:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 16:16:24 (1787602584) 00000020:00080000:1.0:1787602584.770870:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787602584.770907:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787602584.770920:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:1.0:1787602584.770956:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000100:00100000:1.0:1787602585.197085:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405fa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853681536:0@lo:400:kworker.0 00000100:00100000:1.0:1787602585.197190:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602585.197449:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874436853681664:0@lo:400:kworker.0 00000100:00100000:2.0:1787602585.197490:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602585.197620:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853681536 00000100:00100000:3.0:1787602585.197629:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853681536 00000100:00100000:3.0:1787602585.197690:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787602585.197701:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853681536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602585.201934:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853681664 00000100:00100000:2.0:1787602585.201960:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853681664 00000100:00100000:2.0:1787602585.202071:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787602585.202085:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874436853681664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602585.202227:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874436853681664:12345-0@lo:400:kworker.0 Request processed in 145us (4735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602585.202236:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787602585.202320:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874436853681664:0@lo:400:kworker.0 00000100:00100000:0.0:1787602585.202738:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853681920:0@lo:400:kworker.0 00000100:00100000:0.0:1787602585.202810:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602585.202848:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787602585.202854:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853681792:0@lo:400:kworker.0 00000100:00100000:0.0:1787602585.202882:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602585.202913:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853681920 00000100:00100000:0.0:1787602585.202919:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853681920 00000100:00100000:0.0:1787602585.202993:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787602585.203003:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853681920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602585.203579:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853681920:12345-0@lo:400:kworker.0 Request processed in 574us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602585.203588:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787602585.203630:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853681792 00000100:00100000:0.0:1787602585.203636:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853681792 00000100:00100000:0.0:1787602585.203670:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787602585.203677:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853681792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602585.203716:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853681792:12345-0@lo:400:kworker.0 Request processed in 40us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602585.203723:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1787602585.203768:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787602585.203785:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602585.203827:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853681792:0@lo:400:kworker.0 00000100:00100000:0.0:1787602585.203837:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853681920:0@lo:400:kworker.0 00000100:00100000:2.0:1787602585.204260:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853682176:0@lo:400:kworker.0 00000100:00100000:2.0:1787602585.204320:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602585.204360:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787602585.204367:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853682048:0@lo:400:kworker.0 00000100:00100000:2.0:1787602585.204397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602585.204442:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853682048 00000100:00100000:2.0:1787602585.204448:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853682048 00000100:00100000:2.0:1787602585.204485:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787602585.204493:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853682048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602585.204536:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853682048:12345-0@lo:400:kworker.0 Request processed in 44us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602585.204542:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787602585.204578:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853682048:0@lo:400:kworker.0 00000100:00100000:0.0:1787602585.204726:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853682176 00000100:00100000:0.0:1787602585.204731:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853682176 00000100:00100000:0.0:1787602585.204798:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787602585.204806:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853682176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602585.204850:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853682176:12345-0@lo:400:kworker.0 Request processed in 45us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602585.204856:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1787602585.204872:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787602585.204875:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602585.204892:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853682176:0@lo:400:kworker.0 00000100:00100000:3.0:1787602585.208859:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3303:x1874436853681536:12345-0@lo:400:kworker.0 Request processed in 11141us (11651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602585.208878:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787602585.221552:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405fa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853681536:0@lo:400:kworker.0 00010000:00010000:2.0:1787602585.262921:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602585.712261:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853682304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602585.712367:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602585.712591:0:10486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853682304 00000100:00100000:2.0:1787602585.712602:0:10486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853682304 00000100:00100000:2.0:1787602585.712671:0:10486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787602585.712681:0:10486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853682304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787602585.712728:0:10486:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602585.712815:0:10486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853682304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602585.712822:0:10486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787602585.713868:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853682304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602585.815655:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602585.815709:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602585.815738:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602585.815851:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602585.816507:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602585.816556:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833776256 00000100:00100000:2.0:1787602585.816568:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833776256 00000100:00100000:2.0:1787602585.816636:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 306 00000100:00100000:2.0:1787602585.816648:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2353:x1874436833776256:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602585.816763:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2353:x1874436833776256:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 95us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602585.816795:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 306 00000100:00100000:2.0:1787602585.816838:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833776512 00000100:00100000:2.0:1787602585.816842:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833776512 00000100:00100000:2.0:1787602585.816883:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833776640 00000100:00100000:2.0:1787602585.816886:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833776640 00000100:00100000:2.0:1787602585.816910:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 106 00000100:00100000:2.0:1787602585.816918:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2353:x1874436833776512:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602585.816949:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2353:x1874436833776512:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 32us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602585.816965:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 106 00000100:00100000:2.0:1787602585.816977:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 107 00000100:00100000:2.0:1787602585.816984:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833776640:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602585.817010:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2354:x1874436833776640:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 27us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602585.817016:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 107 00000100:00100000:2.0:1787602585.817048:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833776768 00000100:00100000:2.0:1787602585.817053:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833776768 00000100:00100000:2.0:1787602585.817085:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833776384 00000100:00100000:2.0:1787602585.817088:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833776384 00000100:00100000:2.0:1787602585.817110:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 179 00000100:00100000:2.0:1787602585.817117:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+6:2353:x1874436833776768:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602585.817148:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+6:2353:x1874436833776768:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 32us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602585.817155:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 179 00000100:00100000:2.0:1787602585.817167:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 180 00000100:00100000:2.0:1787602585.817181:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+19:2354:x1874436833776384:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602585.817236:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+19:2354:x1874436833776384:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 37us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602585.817243:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 180 00000100:00080000:1.0:1787602585.819096:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787602585.819108:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602585.819112:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787602586.286204:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602587.309060:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602587.757036:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853682432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602587.757132:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602587.757238:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853682432 00000100:00100000:0.0:1787602587.757248:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853682432 00000100:00100000:0.0:1787602587.757327:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787602587.757341:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853682432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602587.757389:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602587.757440:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853682432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602587.757468:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787602587.757517:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853682432:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787602587.757775:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787602588.333202:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602588.696546:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602588.696722:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833777024 00000100:00100000:1.0:1787602588.696736:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833777024 00000100:00100000:1.0:1787602588.696854:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 66 00000100:00100000:1.0:1787602588.696868:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+19:12321:x1874436833777024:12345-192.168.201.26@tcp:35:umount.0 00000100:00100000:1.0:1787602588.697711:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+20:12321:x1874436833777024:12345-192.168.201.26@tcp:35:umount.0 Request processed in 839us (1172us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787602588.697722:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 66 00000100:00080000:2.0:1787602588.698294:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602588.708079:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602588.708206:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833777280 00000100:00100000:1.0:1787602588.708221:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833777280 00000100:00100000:1.0:1787602588.708303:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 67 00000100:00100000:1.0:1787602588.708315:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+20:12321:x1874436833777280:12345-192.168.201.26@tcp:35:umount.0 00000100:00100000:1.0:1787602588.709133:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+21:12321:x1874436833777280:12345-192.168.201.26@tcp:35:umount.0 Request processed in 815us (1064us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787602588.709143:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 67 00000100:00100000:2.0:1787602588.718714:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602588.718835:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833777536 00000100:00100000:1.0:1787602588.718850:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833777536 00000100:00100000:1.0:1787602588.718934:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00100000:1.0:1787602588.718947:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3527f61450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+21:12321:x1874436833777536:12345-192.168.201.26@tcp:35:umount.0 00000100:00100000:1.0:1787602588.720188:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3527f61450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+22:12321:x1874436833777536:12345-192.168.201.26@tcp:35:umount.0 Request processed in 1233us (1480us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787602588.720201:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 68 00000100:00100000:2.0:1787602588.725076:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602588.725200:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833777792 00000100:00100000:1.0:1787602588.725215:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833777792 00000100:00100000:1.0:1787602588.725294:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 69 00000100:00100000:1.0:1787602588.725306:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+22:12321:x1874436833777792:12345-192.168.201.26@tcp:35:umount.0 00000100:00100000:1.0:1787602588.726214:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3aefeab-67b4-4a0a-9090-6916c4553638+23:12321:x1874436833777792:12345-192.168.201.26@tcp:35:umount.0 Request processed in 902us (1147us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1787602588.726227:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 69 00000100:00100000:2.0:1787602588.734890:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602588.734949:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602588.735391:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602588.736025:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833777920 00000100:00100000:1.0:1787602588.736040:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833777920 00000100:00100000:1.0:1787602588.736294:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833778176 00000100:00100000:1.0:1787602588.736298:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833778176 00000100:00100000:1.0:1787602588.736315:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833778048 00000100:00100000:1.0:1787602588.736318:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833778048 00000100:00100000:1.0:1787602588.736339:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:1.0:1787602588.736349:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+15:2351:x1874436833777920:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602588.736370:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602588.736396:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3503703c00/0x3640686da09db226 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22bb expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602588.736419:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602588.736502:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+14:2351:x1874436833777920:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 153us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602588.736510:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:1.0:1787602588.736529:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:1.0:1787602588.736535:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+13:2351:x1874436833778176:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602588.736561:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602588.736572:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3528f20200/0x3640686da09db410 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2386 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602588.736602:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602588.736622:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:2351:x1874436833778176:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 88us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602588.736629:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:1.0:1787602588.736642:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:1.0:1787602588.736648:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:2351:x1874436833778048:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602588.737008:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602588.737022:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3511046000/0x3640686da09db18c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2283 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602588.737033:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602588.737054:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2351:x1874436833778048:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 406us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602588.737075:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:3.0:1787602588.739305:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602588.739361:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833778304 00000100:00100000:2.0:1787602588.739374:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833778304 00000100:00100000:2.0:1787602588.739497:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 74 00000100:00100000:2.0:1787602588.739512:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+5:2350:x1874436833778304:12345-192.168.201.26@tcp:9:umount.0 00000020:00000080:2.0:1787602588.739566:0:6691:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09dbbaa 00000100:00080000:2.0:1787602588.739579:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8d353cc8f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787602588.739636:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787602588.740334:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+2:2350:x1874436833778304:12345-192.168.201.26@tcp:9:umount.0 Request processed in 822us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602588.740345:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 74 00010000:00010000:3.0:1787602588.740822:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787602588.743756:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602588.744504:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602588.746226:0:8625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833778688 00000100:00100000:1.0:1787602588.746248:0:8625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833778688 00000100:00100000:1.0:1787602588.746414:0:8625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 75 00000100:00100000:1.0:1787602588.746431:0:8625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+7:2350:x1874436833778688:12345-192.168.201.26@tcp:9:umount.0 00000020:00000080:1.0:1787602588.746478:0:8625:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db75f 00000020:00010000:1.0:1787602588.746491:0:8625:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d35050fd000: total 0 00000100:00080000:1.0:1787602588.746499:0:8625:0:(import.c:65:import_set_state_nolock()) ffff8d35050f9800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1787602588.746575:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d35050fd000: total 0 00000001:00000004:1.0:1787602588.746579:0:8625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:0.0:1787602588.746629:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d35050fd000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787602588.746706:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b888428/0x3640686da09dbb02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c255b expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.746793:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005510df02/0x3640686da09dc1a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2729 expref: 5 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602588.746813:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d35050fd000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787602588.746824:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602588.746827:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602588.746828:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602588.747487:0:8625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3aefeab-67b4-4a0a-9090-6916c4553638+2:2350:x1874436833778688:12345-192.168.201.26@tcp:9:umount.0 Request processed in 1057us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602588.747524:0:8625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 75 00000100:00080000:2.0:1787602588.748201:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602588.759086:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602588.759207:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833779712 00000100:00100000:0.0:1787602588.759223:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833779712 00000100:00100000:0.0:1787602588.759349:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 240 00000100:00100000:0.0:1787602588.759363:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+23:2350:x1874436833779712:12345-192.168.201.26@tcp:39:umount.0 00000020:00000080:0.0:1787602588.759415:0:5838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db19a 00000020:00010000:0.0:1787602588.759439:0:5838:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d3534d89800: total 0 00000100:00080000:0.0:1787602588.759444:0:5838:0:(import.c:65:import_set_state_nolock()) ffff8d3534d8f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787602588.759487:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1787602588.760364:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3aefeab-67b4-4a0a-9090-6916c4553638+22:2350:x1874436833779712:12345-192.168.201.26@tcp:39:umount.0 Request processed in 997us (1287us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787602588.760377:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 240 00000020:00010000:3.0:1787602588.760458:0:7633:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d3534d89800: total 0 00010000:00010000:3.0:1787602588.760514:0:7633:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d3534d89800, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1787602588.760568:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:3.0:1787602588.760573:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602588.760585:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2600/0x3640686da09dc088 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c26dc expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.760617:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:3.0:1787602588.760619:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787602588.760623:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb400/0x3640686da09db7c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2482 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.760639:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:3.0:1787602588.760642:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787602588.760646:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4800/0x3640686da09dbb80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c257e expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.760695:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d3504d95000) 00010000:00010000:3.0:1787602588.760698:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787602588.760702:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dbe66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2650 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.760722:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:3.0:1787602588.760725:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602588.760729:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09db9e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c250e expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.760796:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d350cd81d00) 00010000:00010000:3.0:1787602588.760799:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787602588.760803:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eb000/0x3640686da09db4d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c23b0 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.760823:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:3.0:1787602588.760825:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602588.760829:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4a00/0x3640686da09dc184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c271b expref: 15 pid: 8208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.760842:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:3.0:1787602588.760844:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602588.760847:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5c00/0x3640686da09dbac3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2546 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.760858:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:3.0:1787602588.760860:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787602588.760870:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4000/0x3640686da09dc15a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2714 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.760885:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502900) 00010000:00010000:3.0:1787602588.760888:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602588.760892:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e2c00/0x3640686da09dbb64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2577 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.760920:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d350b502400) 00010000:00010000:3.0:1787602588.760922:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602588.760927:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09db480 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c239b expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.760945:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d3504d95900) 00010000:00010000:3.0:1787602588.760948:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602588.760952:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e4400/0x3640686da09db464 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2394 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.760966:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:3.0:1787602588.760968:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787602588.760972:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35378e5600/0x3640686da09dbaed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2554 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.760987:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d3529dc7d00) 00010000:00010000:3.0:1787602588.760989:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787602588.760993:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432400/0x3640686da09dc192 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2722 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602588.761005:0:7633:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d3534d89800, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1787602588.761026:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602588.761029:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602588.761031:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602589.357196:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787602589.870126:0:12516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e3aefeab-67b4-4a0a-9090-6916c4553638 00000020:00000080:2.0:1787602589.870163:0:12516:0:(genops.c:885:class_export_put()) final put ffff8d35050fd000/e3aefeab-67b4-4a0a-9090-6916c4553638 00000020:00000080:2.0:1787602589.870959:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d35050fd000/e3aefeab-67b4-4a0a-9090-6916c4553638 for lustre-OST0000 00000020:00000080:2.0:1787602589.871025:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d35050f9800 for lustre-OST0000 00000001:00100000:1.0:1787602589.892495:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e3aefeab-67b4-4a0a-9090-6916c4553638 00000001:00080000:1.0:1787602589.892520:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1787602589.892540:0:5858:0:(genops.c:885:class_export_put()) final put ffff8d3534d89800/e3aefeab-67b4-4a0a-9090-6916c4553638 00000020:00000080:2.0:1787602589.892603:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3534d89800/e3aefeab-67b4-4a0a-9090-6916c4553638 for lustre-MDT0000 00000020:00000080:2.0:1787602589.892697:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3534d8f800 for lustre-MDT0000 00000100:00100000:1.0:1787602590.319129:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405fa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853682944:0@lo:400:kworker.0 00000100:00100000:1.0:1787602590.319232:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602590.319334:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787602590.319341:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853682816:0@lo:400:kworker.0 00000100:00100000:1.0:1787602590.319398:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602590.319440:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853682944 00000100:00100000:1.0:1787602590.319450:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853682944 00000100:00100000:1.0:1787602590.319526:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787602590.319537:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853682944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602590.319604:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853682944:12345-0@lo:400:kworker.0 Request processed in 68us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602590.319613:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787602590.319640:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853682816 00000100:00100000:1.0:1787602590.319645:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853682816 00000100:00100000:1.0:1787602590.319674:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787602590.319681:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853682816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602590.319716:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853682816:12345-0@lo:400:kworker.0 Request processed in 35us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602590.319722:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787602590.319814:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853682816:0@lo:400:kworker.0 00000100:00100000:1.0:1787602590.319824:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405fa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853682944:0@lo:400:kworker.0 00000100:00100000:0.0:1787602590.321769:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874436853682688:0@lo:400:kworker.0 00000100:00100000:0.0:1787602590.321886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602590.321942:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853683200:0@lo:400:kworker.0 00000100:00100000:0.0:1787602590.321969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602590.322008:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787602590.322015:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853682560:0@lo:400:kworker.0 00000100:00100000:0.0:1787602590.322043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602590.322063:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35351c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853683072:0@lo:400:kworker.0 00000100:00100000:0.0:1787602590.322082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602590.322114:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853683200 00000100:00100000:0.0:1787602590.322121:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853683200 00000100:00100000:0.0:1787602590.322185:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787602590.322195:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853683200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602590.322250:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853683200:12345-0@lo:400:kworker.0 Request processed in 56us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602590.322256:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787602590.322280:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853682688 00000100:00100000:0.0:1787602590.322284:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853682688 00000100:00100000:0.0:1787602590.322305:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853683072 00000100:00100000:0.0:1787602590.322308:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853683072 00000100:00100000:0.0:1787602590.322323:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787602590.322329:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874436853682688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602590.322359:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874436853682688:12345-0@lo:400:kworker.0 Request processed in 30us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602590.322365:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787602590.322377:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787602590.322383:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853683072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602590.322422:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874436853683072:12345-0@lo:400:kworker.0 Request processed in 39us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602590.322428:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787602590.322463:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35351c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1874436853683072:0@lo:400:kworker.0 00000100:00100000:0.0:1787602590.322475:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874436853682688:0@lo:400:kworker.0 00000100:00100000:0.0:1787602590.322483:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853683200:0@lo:400:kworker.0 00000100:00080000:2.0:1787602590.323851:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787602590.323860:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787602590.323863:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602590.323898:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853682560 00000100:00100000:2.0:1787602590.323907:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853682560 00000100:00100000:2.0:1787602590.323974:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787602590.323986:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3304:x1874436853682560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602590.324071:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3304:x1874436853682560:12345-0@lo:400:kworker.0 Request processed in 88us (2026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602590.324077:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787602590.329191:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d100a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853682560:0@lo:400:kworker.0 00010000:00010000:0.0:1787602590.383938:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602590.492461:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602590.492511:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602590.492550:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602590.492693:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833779840 00000100:00100000:0.0:1787602590.492708:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833779840 00000100:00100000:0.0:1787602590.492821:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833780096 00000100:00100000:0.0:1787602590.492825:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833780096 00000100:00100000:0.0:1787602590.492841:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833779968 00000100:00100000:0.0:1787602590.492844:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833779968 00000100:00100000:0.0:1787602590.492861:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:0.0:1787602590.492896:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+12:2354:x1874436833779840:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602590.492918:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602590.492944:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d353d432a00/0x3640686da09db26c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22d0 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602590.492967:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602590.493060:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+11:2354:x1874436833779840:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 188us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602590.493069:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:0.0:1787602590.493090:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:0.0:1787602590.493283:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+10:2354:x1874436833780096:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602590.493318:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602590.493332:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3528f21000/0x3640686da09db409 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c237f expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602590.493345:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602590.493346:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:3.0:1787602590.493360:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:2354:x1874436833779968:12345-192.168.201.26@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787602590.493369:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+9:2354:x1874436833780096:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 271us (856us total) trans 0 rc 0/0 00010000:00010000:3.0:1787602590.493373:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787602590.493380:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 21 00010000:00010000:3.0:1787602590.493389:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3503702800/0x3640686da09db273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22fa expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602590.493402:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602590.493427:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18c5f36f-e756-4a04-aae1-8fa064a1d6be+7:2354:x1874436833779968:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 71us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602590.493436:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:1.0:1787602590.510337:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602590.510674:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833780352 00000100:00100000:0.0:1787602590.510691:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833780352 00000100:00100000:0.0:1787602590.510823:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 241 00000100:00100000:0.0:1787602590.510839:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+6:2350:x1874436833780352:12345-192.168.201.26@tcp:39:umount.0 00000020:00000080:0.0:1787602590.510902:0:5838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db281 00000020:00010000:0.0:1787602590.510913:0:5838:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d3503e41000: total 0 00000100:00080000:0.0:1787602590.510917:0:5838:0:(import.c:65:import_set_state_nolock()) ffff8d3503e40000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787602590.510950:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1787602590.511396:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:334d0685-d8e1-4308-8cca-e2aac90898dd+5:2350:x1874436833780352:12345-192.168.201.26@tcp:39:umount.0 Request processed in 561us (1077us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787602590.511403:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 241 00000020:00010000:3.0:1787602590.511499:0:7633:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d3503e41000: total 0 00010000:00010000:3.0:1787602590.511503:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602590.511554:0:7633:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d3503e41000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787602590.511591:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502900) 00010000:00010000:3.0:1787602590.511595:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602590.511601:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354eaa00/0x3640686da09dc1b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2730 expref: 4 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602590.511621:0:7633:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d3503e41000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787602590.511627:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602590.511628:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602590.511646:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787602590.512009:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602590.552060:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602590.552179:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833780608 00000100:00100000:2.0:1787602590.552195:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833780608 00000100:00100000:2.0:1787602590.552276:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 308 00000100:00100000:2.0:1787602590.552289:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+7:2350:x1874436833780608:12345-192.168.201.26@tcp:251:umount.0 00000020:00000080:2.0:1787602590.552351:0:5831:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db177 00000020:00010000:2.0:1787602590.552361:0:5831:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d3534d8a800: total 0 00000100:00080000:2.0:1787602590.552367:0:5831:0:(import.c:65:import_set_state_nolock()) ffff8d3534d8d800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787602590.552465:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18c5f36f-e756-4a04-aae1-8fa064a1d6be+3:2350:x1874436833780608:12345-192.168.201.26@tcp:251:umount.0 Request processed in 178us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602590.552474:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 308 00000020:00010000:3.0:1787602590.552614:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d3534d8a800: total 0 00010000:00010000:3.0:1787602590.552666:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d3534d8a800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787602590.552708:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3503703a00/0x3640686da09db22d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c22c2 expref: 2 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602590.552727:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d3534d8a800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787602590.552735:0:5825:0:(genops.c:885:class_export_put()) final put ffff8d3534d8a800/18c5f36f-e756-4a04-aae1-8fa064a1d6be 00010000:00010000:3.0:1787602590.552806:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602590.552808:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602590.552810:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787602590.553350:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3534d8a800/18c5f36f-e756-4a04-aae1-8fa064a1d6be for MGS 00000020:00000080:2.0:1787602590.553389:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3534d8d800 for MGS 00000100:00100000:0.0:1787602590.828913:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853683328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602590.829811:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602590.829935:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853683328 00000100:00100000:0.0:1787602590.829947:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853683328 00000100:00100000:0.0:1787602590.830958:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787602590.831280:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853683328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787602590.831363:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602590.831472:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853683328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 502us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602590.831480:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787602590.831838:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853683328:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787602591.407485:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787602591.858702:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787602591.858714:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787602591.859193:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787602591.859202:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:2.0:1787602591.950310:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e3aefeab-67b4-4a0a-9090-6916c4553638 00000020:00000080:2.0:1787602591.950325:0:7646:0:(genops.c:885:class_export_put()) final put ffff8d353cc88000/e3aefeab-67b4-4a0a-9090-6916c4553638 00000020:00000080:2.0:1787602591.950360:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d353cc88000/e3aefeab-67b4-4a0a-9090-6916c4553638 for lustre-OST0001 00000020:00000080:2.0:1787602591.950413:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d353cc8f000 for lustre-OST0001 00000020:01000004:2.0:1787602592.317629:0:13017:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787602592.333515:0:13017:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787602592.333587:0:13017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db203 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602592.333605:0:13017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db203 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602592.333613:0:13017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db203 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602592.333621:0:13017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db203 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602592.333645:0:13017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787602592.333652:0:13017:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1787602592.333689:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602592.333696:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db203 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602592.333705:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702000 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:3.0:1787602592.333727:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db203 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602592.333736:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x3640686da09db203 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602592.333760:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x3640686da09db203 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602592.333766:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787602592.333768:0:7633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787602592.333771:0:7633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787602592.333818:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db203 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602592.333825:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602592.333869:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db203 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602592.333877:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3503702000/0x3640686da09db1fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db203 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602592.333889:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602592.333890:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602592.333892:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787602592.333921:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787602592.333928:0:13017:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787602592.333936:0:13017:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787602592.334882:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602592.334916:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853683456:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787602592.336187:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8d35271f9000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787602592.338217:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602592.339548:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874436853683584:0@lo:39:umount.0 00000100:00100000:2.0:1787602592.339629:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602592.340400:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853683584 00000100:00100000:1.0:1787602592.340414:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853683584 00000100:00100000:1.0:1787602592.340487:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787602592.340500:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874436853683584:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787602592.340545:0:5836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09daf86 00000100:00080000:1.0:1787602592.340558:0:5836:0:(import.c:65:import_set_state_nolock()) ffff8d3534cba800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787602592.340660:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3300:x1874436853683584:12345-0@lo:39:umount.0 Request processed in 162us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602592.340669:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787602592.340682:0:5836:0:(genops.c:885:class_export_put()) final put ffff8d3534cbe000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1787602592.340711:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602592.340854:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853683456 00000100:00100000:0.0:1787602592.340860:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853683456 00000100:00080000:2.0:1787602592.341089:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d35271f9000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787602592.341110:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874436853683584:0@lo:39:umount.0 00000020:00000080:2.0:1787602592.341148:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3534cbe000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787602592.341207:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3534cba800 for lustre-MDT0000 00000100:00100000:0.0:1787602592.341473:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787602592.341485:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350a3a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3301:x1874436853683456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787602592.341501:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602592.341528:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3528f20600/0x3640686da09db203 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3640686da09db1fc expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602592.341547:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602592.341599:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350a3a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:3301:x1874436853683456:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (3392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602592.341606:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787602592.341680:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853683456:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787602592.342379:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787602592.342386:0:13017:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787602592.342393:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787602592.345868:0:13017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db211 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.345892:0:13017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db211 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.345900:0:13017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db211 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.345937:0:13017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db211 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348138:0:13017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787602592.348164:0:13017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db138 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348178:0:13017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db138 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348185:0:13017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db138 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348191:0:13017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db138 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348204:0:13017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787602592.348212:0:13017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db43a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348219:0:13017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db43a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348225:0:13017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db43a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348230:0:13017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db43a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348277:0:13017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787602592.348294:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787602592.348301:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db211 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348311:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3528f20800 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602592.348315:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db211 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348325:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x3640686da09db211 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602592.348333:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x3640686da09db211 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602592.348339:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787602592.348342:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787602592.348395:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db211 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348402:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602592.348442:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db211 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348450:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3528f20800/0x3640686da09db20a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db211 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348468:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787602592.348471:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db138 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348483:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3528f20e00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602592.348486:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db138 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348493:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3640686da09db138 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602592.348500:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3640686da09db138 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602592.348505:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787602592.348508:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787602592.348511:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787602592.348528:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db138 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348535:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602592.348542:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db138 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348548:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3528f20e00/0x3640686da09db131 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db138 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348563:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602592.348566:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db43a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348572:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3528f21e00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602592.348575:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db43a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348588:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3640686da09db43a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602592.348595:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3640686da09db43a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602592.348601:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787602592.348603:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787602592.348605:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787602592.348619:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db43a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348625:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602592.348642:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db43a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348649:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3528f21e00/0x3640686da09db433 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db43a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.348660:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602592.348662:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602592.348663:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602592.348686:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853683840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787602592.348817:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602592.348899:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787602592.348906:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853683712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787602592.348930:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602592.348968:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853683840 00000100:00100000:1.0:1787602592.348978:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853683840 00000100:00100000:1.0:1787602592.349042:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853683712 00000100:00100000:1.0:1787602592.349046:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853683712 00000100:00100000:1.0:1787602592.349071:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787602592.349080:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+19:3304:x1874436853683840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787602592.349098:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602592.349119:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3500030a00/0x3640686da09db138 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3640686da09db131 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.349139:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602592.349181:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+18:3304:x1874436853683840:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602592.349188:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787602592.349207:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787602592.349214:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+17:3304:x1874436853683712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787602592.349224:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602592.349234:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3528f20a00/0x3640686da09db211 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3640686da09db20a expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.349243:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602592.349265:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:3304:x1874436853683712:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602592.349271:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787602592.349314:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853683712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787602592.349323:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853683840:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787602592.349355:0:13017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031c00/0x3640686da09daee5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09daeec expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.349377:0:13017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031c00/0x3640686da09daee5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09daeec expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.349384:0:13017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500031c00/0x3640686da09daee5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09daeec expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.349391:0:13017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff8d3500031c00/0x3640686da09daee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09daeec expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.349406:0:13017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787602592.349411:0:13017:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787602592.349414:0:13017:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1787602592.349457:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602592.349461:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3500031c00/0x3640686da09daee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09daeec expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.349468:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3500031c00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602592.349471:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031c00/0x3640686da09daee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09daeec expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.349479:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3500031c00/0x3640686da09daee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3640686da09daeec expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602592.349485:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3500031c00/0x3640686da09daee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3640686da09daeec expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602592.349491:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787602592.349494:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787602592.349496:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787602592.349520:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3500031c00/0x3640686da09daee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09daeec expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.349527:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602592.349536:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3500031c00/0x3640686da09daee5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09daeec expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.349543:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3500031c00/0x3640686da09daee5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09daeec expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.349556:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602592.349558:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602592.349559:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787602592.349576:0:13017:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787602592.349582:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787602592.349587:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787602592.349595:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1787602592.349602:0:13017:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d3534812000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787602592.349608:0:13017:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d340432e800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787602592.349618:0:13017:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8d3503e41000 334d0685-d8e1-4308-8cca-e2aac90898dd 192.168.201.26@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787602592.349624:0:13017:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8d353d790000) has exports, disconnecting them 00000020:00080000:1.0:1787602592.349631:0:13017:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d3534812000), last request at 1787602590 00000020:00000080:1.0:1787602592.349641:0:13017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db0f9 00000100:00080000:1.0:1787602592.349663:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8d3534812800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787602592.349706:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787602592.349719:0:13017:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d3534812000): rc 0 00000020:00000080:1.0:1787602592.349721:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d3534812000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787602592.349730:0:13017:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d340432e800), last request at 1787602590 00000020:00000080:1.0:1787602592.349733:0:13017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db02e 00000100:00080000:1.0:1787602592.349764:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8d3404328800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787602592.349773:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787602592.349778:0:13017:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d340432e800): rc 0 00000020:00000080:1.0:1787602592.349780:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d340432e800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1787602592.349788:0:13017:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffad9942cb7ae0 00000100:00080000:1.0:1787602592.349813:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787602592.349818:0:13017:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1787602592.349831:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787602592.349915:0:13017:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787602592.349931:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8d35271fa800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787602592.349946:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787602592.349948:0:13017:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787602592.349958:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787602592.350030:0:13017:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787602592.350040:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8d3534d8e000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787602592.350073:0:13017:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d353d790000) has no exports 00000020:00000080:2.0:1787602592.350165:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3534812000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787602592.350285:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d340432e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1787602592.350299:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787602592.350316:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3534812800 for lustre-MDT0000 00000100:00100000:0.0:1787602592.350316:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853683968:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1787602592.350321:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3404328800 for lustre-MDT0000 00000100:00100000:2.0:1787602592.350333:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853684224:0@lo:9:umount.0 00000100:00100000:2.0:1787602592.350366:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602592.350366:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602592.350619:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853683968 00000100:00100000:3.0:1787602592.350627:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853683968 00000100:00100000:3.0:1787602592.350679:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787602592.350688:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405080000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:3301:x1874436853683968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602592.350700:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602592.350716:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3503702200/0x3640686da09db43a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3640686da09db433 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602592.350728:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602592.350803:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853684352:0@lo:9:umount.0 00000100:00100000:1.0:1787602592.350804:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853684096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787602592.350830:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602592.350830:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602592.350887:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853684096 00000100:00100000:1.0:1787602592.350891:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853684096 00000100:00100000:2.0:1787602592.350893:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853684224 00000100:00100000:2.0:1787602592.350896:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853684224 00000100:00100000:1.0:1787602592.350913:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787602592.350919:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+16:3302:x1874436853684096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787602592.350928:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602592.350939:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3503702e00/0x3640686da09daeec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3640686da09daee5 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602592.350951:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602592.350981:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+15:3302:x1874436853684096:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602592.350997:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787602592.351016:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853684352 00000100:00100000:2.0:1787602592.351019:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853684352 00000100:00100000:1.0:1787602592.351030:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3302:1874436853684096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787602592.351057:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787602592.351065:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874436853684224:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787602592.351093:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db07b 00000100:00080000:2.0:1787602592.351101:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8d340432e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787602592.351139:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787602592.351668:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3300:x1874436853684224:12345-0@lo:9:umount.0 Request processed in 604us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602592.351676:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787602592.351690:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787602592.351697:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35357d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874436853684352:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787602592.351711:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db162 00000100:00080000:2.0:1787602592.351719:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8d3405c72800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787602592.351739:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:1.0:1787602592.351799:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d35271fa800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787602592.351811:0:3300:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787602592.351813:0:3300:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787602592.351816:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853684224:0@lo:9:umount.0 00010000:00010000:0.0:1787602592.351983:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602592.352003:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35357d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3300:x1874436853684352:12345-0@lo:9:umount.0 Request processed in 306us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602592.352010:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:0.0:1787602592.352017:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787602592.352029:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787602592.352034:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602592.352084:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d3534d8e000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787602592.352881:0:3300:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787602592.352885:0:3300:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787602592.352891:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853684352:0@lo:9:umount.0 00000100:00100000:3.0:1787602592.354108:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405080000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:3301:x1874436853683968:12345-0@lo:103:ldlm_bl.0 Request processed in 3412us (3733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602592.354122:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787602592.354160:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602592.355405:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853683968:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787602592.364166:0:13017:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d353d790000) has no exports 00000020:00000080:1.0:1787602592.412435:0:13017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09daf40 00000020:00000080:1.0:1787602592.412452:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d353d258800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787602592.412473:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787602592.412812:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d353d258800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787602592.412946:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787602592.412981:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787602592.412990:0:13017:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8d350c9c4d28) has no exports 00000020:00000080:0.0:1787602592.413496:0:13017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09daf39 00000020:00000080:0.0:1787602592.413507:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d3536b6b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787602592.413578:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787602592.413587:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787602592.413590:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d3534628000/lustre-QMT0000_UUID 00000020:00000080:0.0:1787602592.413593:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3534628000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787602592.413603:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1787602592.414562:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3536b6b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1787602592.429306:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602593.453216:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602594.477039:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787602594.996018:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787602594.996030:0:6714:0:(genops.c:885:class_export_put()) final put ffff8d3404328000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787602594.996115:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3404328000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787602594.996176:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d340432e000 for lustre-OST0000 00000001:00100000:1.0:1787602595.043439:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 334d0685-d8e1-4308-8cca-e2aac90898dd 00000001:00080000:1.0:1787602595.043470:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1787602595.043479:0:5858:0:(genops.c:885:class_export_put()) final put ffff8d3503e41000/334d0685-d8e1-4308-8cca-e2aac90898dd 00000020:00000080:2.0:1787602595.043655:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3503e41000/334d0685-d8e1-4308-8cca-e2aac90898dd for lustre-MDT0000 00000020:00000080:2.0:1787602595.043770:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3503e40000 for lustre-MDT0000 00000100:00100000:1.0:1787602595.437297:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787602595.437366:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602595.437396:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853684608:0@lo:400:kworker.0 00000100:00100000:2.0:1787602595.437505:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602595.437628:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853684480:0@lo:400:kworker.0 00000100:00100000:1.0:1787602595.437684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602595.437850:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853684480 00000100:00100000:2.0:1787602595.437861:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853684480 00000100:00100000:2.0:1787602595.437964:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1787602595.437978:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3502e27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:3304:x1874436853684480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602595.438020:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874436853684736:0@lo:400:kworker.0 00000100:00100000:0.0:1787602595.438057:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602595.438094:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3502e27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1b36f9a3-2dc4-4d93-bb16-52c7c573162a+14:3304:x1874436853684480:12345-0@lo:400:kworker.0 Request processed in 118us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602595.438103:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1787602595.440256:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853684480:0@lo:400:kworker.0 00000100:00100000:3.0:1787602595.443176:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853684608 00000100:00100000:3.0:1787602595.443199:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853684608 00000100:00100000:3.0:1787602595.445076:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853684736 00000100:00100000:3.0:1787602595.445095:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853684736 00000100:00100000:2.0:1787602595.457080:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787602595.457100:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874436853684608:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787602595.457115:0:5836:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787602595.457253:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874436853684608:12345-0@lo:400:kworker.0 Request processed in 154us (19748us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787602595.457262:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787602595.457298:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787602595.457304:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1874436853684736:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787602595.457309:0:5836:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787602595.457351:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1874436853684736:12345-0@lo:400:kworker.0 Request processed in 46us (19293us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787602595.457358:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1787602595.457423:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787602595.457431:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8d3405c71800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787602595.457436:0:3301:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787602595.458071:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787602595.458077:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8d353787f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787602595.458080:0:3303:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787602595.458086:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8d353787f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787602595.458091:0:3303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 156 00000100:00080000:0.0:1787602595.458100:0:3303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d353787f000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:0.0:1787602595.458142:0:3303:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3405082d80 x1874436853684864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787602595.458191:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853684608:0@lo:400:kworker.0 00000100:00100000:0.0:1787602595.458254:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1874436853684864:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787602595.458307:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602595.458376:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853684864 00000100:00100000:0.0:1787602595.458403:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853684864 00000100:00100000:0.0:1787602595.458443:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787602595.458449:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3300:x1874436853684864:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1787602595.458470:0:5837:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1787602595.479210:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8d3405c71800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787602595.479224:0:3301:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 176 00000100:00080000:2.0:1787602595.479237:0:3301:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d3405c71800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:2.0:1787602595.479528:0:3301:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d35378f5180 x1874436853684992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787602595.479618:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1874436853684992:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787602595.479727:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602595.479801:0:8208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853684992 00000100:00100000:1.0:1787602595.479812:0:8208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853684992 00000100:00100000:1.0:1787602595.479863:0:8208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787602595.479875:0:8208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3300:x1874436853684992:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787602595.479898:0:8208:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787602595.480006:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874436853684736:0@lo:400:kworker.0 00000100:00100000:1.0:1787602595.480047:0:8208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3300:x1874436853684992:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 172us (320us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787602595.480067:0:8208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1787602595.489597:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d3405c71800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787602595.489614:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787602595.489620:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1874436853684992:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1787602595.501014:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602595.508009:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3300:x1874436853684864:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 49542us (49684us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787602595.508030:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1787602595.508215:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d353787f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787602595.508223:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787602595.508229:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1874436853684864:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1787602596.526035:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787602597.072583:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787602597.072598:0:7646:0:(genops.c:885:class_export_put()) final put ffff8d3405c70800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787602597.072714:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3405c70800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787602597.073198:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3405c72800 for lustre-OST0001 00010000:00010000:3.0:1787602597.549127:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787602598.509050:0:13017:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d3503ec26c0 - data ffff8d353ff2f870/ffff8d3534f4b000 00000020:01000000:0.0:1787602598.509211:0:13017:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d35054ba2a0 - data ffff8d3516f3f1b0/ffff8d353510c000 00000001:00000004:0.0:1787602598.518146:0:13017:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:0.0:1787602598.573112:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787602598.630616:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787602598.630625:0:13017:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787602598.630638:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787602598.630641:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787602598.631467:0:6991:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787602598.631473:0:6991:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1787602598.631484:0:6991:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787602598.632395:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787602598.632400:0:13017:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1787602598.632418:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787602598.632428:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787602598.632670:0:8062:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787602598.632673:0:8062:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1787602598.632679:0:8062:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787602598.691706:0:13017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09daf08 00000020:00000080:0.0:1787602598.691719:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d3534647800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787602598.691870:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3534647800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787602598.693721:0:13017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09daf1d 00000020:00000080:0.0:1787602598.694351:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d353d79d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787602598.694366:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787602598.694371:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787602598.694381:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787602598.694386:0:13017:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8d353d794d28) has no exports 00000004:01000000:0.0:1787602598.694561:0:13017:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787602598.694571:0:13017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db15b 00000020:00000080:0.0:1787602598.694576:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d3534d8a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787602598.694580:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787602598.694584:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787602598.694589:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787602598.694592:0:13017:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8d353977cd28) has no exports 00000020:00000080:0.0:1787602598.694608:0:13017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db154 00000020:00000080:0.0:1787602598.694612:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d3534d8f000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787602598.695087:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d353d79d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1787602598.695098:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3534d8a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787602598.695103:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3534d8f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787602598.696876:0:13017:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787602598.696885:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787602598.696890:0:13017:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1787602598.696898:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787602598.696900:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787602598.697028:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3534d8e000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787602598.697199:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787602598.697213:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787602598.697218:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d35271fd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787602598.697221:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8d35271fd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787602598.697239:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787602598.697325:0:13017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db074 00000020:00000080:1.0:1787602598.697331:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d3404b17800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787602598.697386:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787602598.697391:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787602598.697398:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787602598.697402:0:13017:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8d34049c0000) has no exports 00000020:00000080:1.0:1787602598.697418:0:13017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db06d 00000020:00000080:1.0:1787602598.697422:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d35271fa000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787602598.697908:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3404b17800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1787602598.698668:0:13017:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787602598.698673:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787602598.698676:0:13017:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1787602598.698681:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787602598.698683:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787602598.698712:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787602598.698719:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787602598.699199:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787602598.699205:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787602598.699209:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d3534644000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787602598.699212:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3534644000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787602598.699218:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787602598.699489:0:13017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09daf24 00000020:00000080:1.0:1787602598.699496:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d353d79d000/lustre-MDD0000_UUID 00000020:01000000:1.0:1787602598.699502:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787602598.699507:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787602598.699511:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787602598.699515:0:13017:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8d353d793370) has no exports 00000020:00000080:1.0:1787602598.699534:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787602598.699538:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787602598.699542:0:13017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09daf2b 00000020:00000080:1.0:1787602598.699546:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d353d79b800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787602598.699552:0:13017:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d3509288800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787602598.699555:0:13017:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3509288800 3 00000020:01000004:1.0:1787602598.699558:0:13017:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d3509288800 from lustre-MDT0000 00000020:00000080:1.0:1787602598.699576:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787602598.699579:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787602598.699582:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d3534643000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787602598.699584:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3534643000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787602598.699591:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787602598.699627:0:13017:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1787602598.699631:0:13017:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787602598.699633:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787602598.699636:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787602598.699639:0:13017:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787602598.699645:0:13017:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8d350b51e000 1b36f9a3-2dc4-4d93-bb16-52c7c573162a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787602598.699651:0:13017:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8d35035c19b8) has exports, disconnecting them 00000020:00080000:1.0:1787602598.699655:0:13017:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d350b51e000), last request at 1787602351 00000020:00000080:1.0:1787602598.699669:0:13017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09daec9 00000020:00010000:1.0:1787602598.699674:0:13017:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d350b51e000: total 3 00000100:00080000:1.0:1787602598.699678:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8d350b51a000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787602598.699705:0:13017:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d350b51e000): rc 0 00000020:00080000:1.0:1787602598.699710:0:13017:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8d35035c19b8) has no exports 00000020:00010000:3.0:1787602598.699946:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d350b51e000: total 3 00010000:00010000:3.0:1787602598.699983:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d350b51e000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787602598.700014:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3500031e00/0x3640686da09db21f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3640686da09db218 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602598.700034:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d353d433600/0x3640686da09db41e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3640686da09db417 expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602598.700044:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3503703e00/0x3640686da09db42c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3640686da09db425 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602598.700059:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3503703400/0x3640686da09dafe1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3640686da09dafda expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602598.700071:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3528f21200/0x3640686da09db1cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3640686da09db1c4 expref: 5 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602598.700084:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3500030c00/0x3640686da09db1d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3640686da09db1d2 expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602598.700095:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3503702600/0x3640686da09db1e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3640686da09db1e0 expref: 3 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602598.700107:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d353d432c00/0x3640686da09db1f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3640686da09db1ee expref: 2 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602598.700117:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d350b51e000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1787602598.700129:0:5825:0:(genops.c:885:class_export_put()) final put ffff8d350b51e000/1b36f9a3-2dc4-4d93-bb16-52c7c573162a 00010000:00010000:3.0:1787602598.700135:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602598.700137:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602598.700138:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602598.700384:0:5832:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d3503f4f400:5832] 2 exiting: rc = 0 00000100:00100000:1.0:1787602598.700469:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d35034ade00:5831] 1 exiting: rc = 0 00000020:00000080:0.0:1787602598.700564:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d35271fa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787602598.700573:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d35271fa800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787602598.700578:0:36:0:(genops.c:885:class_export_put()) final put ffff8d34049cb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787602598.700580:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d34049cb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787602598.700585:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787602598.700668:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d353d79d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787602598.700672:0:36:0:(genops.c:885:class_export_put()) final put ffff8d3534647000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787602598.700673:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3534647000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787602598.700677:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787602598.700879:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d353d79b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787602598.700884:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d350b51e000/1b36f9a3-2dc4-4d93-bb16-52c7c573162a for MGS 00000020:00000080:0.0:1787602598.700914:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d350b51a000 for MGS 00000100:00100000:2.0:1787602598.701367:0:5829:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d35034aca00:5829] 0 exiting: rc = 1 00000100:00100000:1.0:1787602598.701988:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.701998:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702004:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702009:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702014:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702019:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702024:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702030:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702035:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702041:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702046:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702050:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702055:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702061:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702066:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702071:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702076:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702082:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702099:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702105:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702110:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702116:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702122:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702127:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702134:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702139:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702144:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702149:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702155:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702160:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702166:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702171:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702176:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702182:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702188:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702194:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702200:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702206:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702213:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702219:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702341:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702352:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702358:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702364:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702369:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702375:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702380:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702384:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702390:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702394:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702400:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702405:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702410:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702423:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702429:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702434:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702439:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702444:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702450:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702456:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702462:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702467:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702473:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.702478:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787602598.703557:0:13017:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787602598.703563:0:13017:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1787602598.704656:0:13017:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d3503ec21e0 - data ffff8d353ff2f510/ffff8d3534f48800 00000020:01000000:1.0:1787602598.704912:0:13017:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d3504819b40 - data ffff8d3516f3d438/ffff8d3503fb5000 00000020:00000080:1.0:1787602598.706070:0:13017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09daead 00000020:00000080:1.0:1787602598.706080:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d3508125000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787602598.706110:0:13017:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d3509288800 from MGS, refs=2 00000020:01000004:1.0:1787602598.706114:0:13017:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3509288800 2 00000020:01000004:1.0:1787602598.706117:0:13017:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d3509288800 from MGS 00000020:00000080:1.0:1787602598.706140:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787602598.706146:0:13017:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787602598.706149:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d3508125800/MGS 00000020:00000080:1.0:1787602598.706151:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3508125800/MGS for MGS 00000020:01000000:1.0:1787602598.706158:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787602598.706217:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787602598.706221:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787602598.706442:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3508125000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787602598.707601:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787602598.707612:0:13017:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d3503e99000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787602598.707620:0:13017:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8d35035c4d28) has exports, disconnecting them 00000020:00080000:0.0:1787602598.707625:0:13017:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d3503e99000), last request at 1787602352 00000020:00000080:0.0:1787602598.707631:0:13017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09daf78 00000020:00080000:0.0:1787602598.707642:0:13017:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d3503e99000): rc 0 00000020:00000080:0.0:1787602598.707648:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d3503e99000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787602598.707922:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3503e99000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787602598.711014:0:13017:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787602598.711023:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787602598.711028:0:13017:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787602598.711035:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787602598.711204:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787602598.711212:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787602598.711218:0:13017:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3509288800 1 00000020:00000080:1.0:1787602598.711246:0:13017:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09dae9f 00000020:00000080:1.0:1787602598.711255:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d3508127000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787602598.711328:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787602598.711335:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787602598.711339:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787602598.711344:0:13017:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8d35397799b8) has no exports 00000020:00000080:3.0:1787602598.711571:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d35271f9000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787602598.711578:0:37:0:(genops.c:885:class_export_put()) final put ffff8d3503e9d800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787602598.711581:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3503e9d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787602598.711588:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787602598.711651:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3508127000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787602598.767311:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787602598.767326:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787602598.767332:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d350928e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787602598.767337:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8d350928e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787602598.767344:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787602598.767480:0:13017:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d3509289000 00000020:01000000:3.0:1787602598.767500:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787602598.767505:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787602598.767509:0:13017:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787602598.767514:0:13017:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8d350c9c19b8) has no exports 00000100:00100000:3.0:1787602598.767595:0:8208:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8d3504f42600:8208] 3 exiting: rc = 0 00000100:00100000:3.0:1787602598.767691:0:5837:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8d350b5e1800:5837] 1 exiting: rc = 0 00000100:00100000:0.0:1787602598.773049:0:5836:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8d3508a16a00:5836] 0 exiting: rc = 1 00000100:00100000:2.0:1787602598.773475:0:5838:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8d350b5e1000:5838] 2 exiting: rc = 0 00000100:00100000:3.0:1787602598.774175:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774184:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774190:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774196:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774202:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774208:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774213:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774219:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774235:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774242:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774248:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774254:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774266:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774286:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774292:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774298:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774303:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774309:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774314:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774320:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774325:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774330:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774336:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774341:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774346:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774351:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774357:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774362:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774367:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774373:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774378:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774384:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774389:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774395:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774401:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774407:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774413:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774419:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774425:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774430:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774436:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774441:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774447:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774452:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774458:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774462:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774468:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774472:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774485:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774490:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774495:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774500:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774505:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774511:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774516:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774521:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774528:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774534:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774539:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774545:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774550:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774555:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774560:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.774565:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.781345:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d350b5e0000:5839] 0 exiting: rc = 1 00000100:00100000:3.0:1787602598.782581:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d350b5e0c00:5840] 1 exiting: rc = 0 00000100:00100000:0.0:1787602598.782723:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782788:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782797:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782824:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782829:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782837:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782842:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782848:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782854:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782860:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782867:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782873:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782880:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782885:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782892:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782897:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782913:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782919:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782932:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782938:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782944:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782949:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782956:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782961:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782966:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782972:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782977:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782983:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782988:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782993:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.782999:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783005:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783011:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783017:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783022:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783028:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783034:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783039:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783053:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783059:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783064:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783070:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783075:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783081:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783086:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783092:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783097:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783103:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783109:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783116:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783122:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783127:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783132:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783138:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783143:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783148:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783153:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783158:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783164:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783169:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783175:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783180:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783186:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.783191:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.784653:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8d3503ed1200:5842] 1 exiting: rc = 0 00000100:00100000:1.0:1787602598.784995:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8d3503ed0200:5841] 0 exiting: rc = 1 00000100:00100000:0.0:1787602598.785113:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785123:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785130:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785136:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785143:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785172:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785180:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785187:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785193:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785214:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785220:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785237:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785243:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785249:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785256:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785390:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785400:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785420:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785427:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785433:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785439:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785445:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785452:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785460:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785466:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785472:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785478:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785484:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785491:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785513:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785521:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785528:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785533:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785542:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785547:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785553:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785559:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785565:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785572:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785579:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785584:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785612:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785620:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785626:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785640:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785646:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785652:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785658:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785665:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785673:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785680:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785687:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785693:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785713:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785720:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785727:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785901:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785910:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785917:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.785922:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.786130:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.786137:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.786143:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.786159:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.805778:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d3508a97c00:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1787602598.807351:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d3503ed0600:5843] 0 exiting: rc = 1 00000100:00100000:3.0:1787602598.807762:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807772:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807787:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807792:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807798:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807809:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807815:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807820:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807825:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807831:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807836:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807841:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807846:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807852:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807857:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807862:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807868:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807891:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807897:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807902:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807907:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807913:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807917:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807932:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807938:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807943:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807949:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807954:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807959:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807964:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807969:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807973:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807979:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807985:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807990:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.807995:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808000:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808006:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808011:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808015:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808020:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808025:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808031:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808036:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808042:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808046:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808052:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808057:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808061:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808066:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808071:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808076:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808090:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808095:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808101:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808106:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808110:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808115:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808120:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808125:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808130:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808135:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808141:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808146:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.808515:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d3502fffe00:5846] 1 exiting: rc = 0 00000100:00100000:1.0:1787602598.809129:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d3503ed1c00:5845] 0 exiting: rc = 1 00000100:00100000:3.0:1787602598.809235:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809243:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809249:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809254:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809320:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809328:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809333:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809338:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809344:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809349:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809354:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809360:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809365:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809371:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809376:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809381:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809387:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809392:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809398:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809403:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809407:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809413:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809433:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809439:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809443:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809448:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809453:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809458:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809463:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809467:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809472:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809476:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809480:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809485:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809489:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809493:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809497:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809502:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809507:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809512:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809516:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809521:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809526:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809531:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809536:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809540:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809545:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809550:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809554:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809559:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809564:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809568:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809573:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809578:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809583:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809588:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809592:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809604:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809609:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809613:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809617:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809621:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809626:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602598.809631:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.811062:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d3502fffa00:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1787602598.812529:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d3502ffe400:5847] 0 exiting: rc = 1 00000100:00100000:1.0:1787602598.812593:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812600:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812606:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812612:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812617:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812623:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812629:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812634:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812640:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812645:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812650:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812656:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812661:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812666:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812672:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812677:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812683:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812688:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812694:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812699:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812716:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812721:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812727:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812780:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812786:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812791:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.812796:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813002:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813011:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813016:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813022:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813028:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813033:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813039:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813045:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813050:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813056:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813060:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813065:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813070:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813075:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813080:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813086:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813091:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813096:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813444:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813450:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813455:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813460:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813466:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813471:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813476:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813481:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813485:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813490:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813507:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813513:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813518:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813524:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813529:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813534:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813539:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813544:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.813549:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602598.814829:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8d3502fff200:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1787602598.815236:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8d3502fff400:5851] 2 exiting: rc = 0 00000100:00100000:3.0:1787602598.815561:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8d3502ffec00:5849] 0 exiting: rc = 1 00000100:00100000:1.0:1787602598.815662:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815670:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815676:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815682:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815688:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815697:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815703:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815708:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815714:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815719:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815724:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815764:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815779:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815785:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815790:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815796:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815810:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815818:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815823:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815829:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815834:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815839:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815844:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815850:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815856:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815873:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815878:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815884:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815905:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815911:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815916:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.815921:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816084:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816090:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816097:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816102:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816107:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816112:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816118:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816123:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816128:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816135:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816140:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816146:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816151:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816157:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816163:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816169:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816174:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816179:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816184:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816190:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816195:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816200:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816205:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816210:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816242:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816250:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816256:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816376:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816393:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816399:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816406:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602598.816412:0:13017:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787602598.823440:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787602598.823454:0:13017:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787602598.823459:0:13017:0:(genops.c:885:class_export_put()) final put ffff8d3503e9e000/MDS_uuid 00000020:00000080:1.0:1787602598.823465:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3503e9e000/MDS_uuid for MDS 00000020:01000000:1.0:1787602598.823470:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787602598.823604:0:13017:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787602599.600166:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787602600.564917:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787602600.564926:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787602600.564930:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d353787f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787602600.564939:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 380 00000100:00080000:2.0:1787602600.564945:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787602600.564952:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d353787f000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:2.0:1787602600.564979:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d35378f5500 x1874436853685248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787602600.564996:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787602600.564999:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787602600.565001:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d3405c71800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787602600.565005:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 380 00000100:00080000:2.0:1787602600.565007:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787602600.565010:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d3405c71800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:2.0:1787602600.565023:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d35378f6680 x1874436853685376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787602600.565050:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787602600.565078:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853685120:0@lo:400:kworker.0 00000400:00000100:2.0:1787602600.565148:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874436853685120 offset 0 length 224: 4 00000100:00100000:2.0:1787602600.565209:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1874436853685248:0@lo:38:kworker.0 00000400:00000100:2.0:1787602600.565231:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874436853685248 offset 0 length 520: 4 00000100:00100000:2.0:1787602600.565244:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1874436853685376:0@lo:38:kworker.0 00000400:00000100:2.0:1787602600.565259:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874436853685376 offset 0 length 520: 4 00010000:00010000:2.0:1787602600.621643:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602601.652016:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787602601.811347:0:13175:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787602601.830441:0:13175:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787602601.830502:0:13175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db1e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.830515:0:13175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db1e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.830522:0:13175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db1e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.830530:0:13175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db1e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.830560:0:13175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787602601.830567:0:13175:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787602601.830597:0:13175:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787602601.830609:0:13175:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d35378f5500 x1874436853685248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787602615 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602601.830634:0:13175:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787602601.830642:0:13175:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787602601.830648:0:13175:0:(import.c:65:import_set_state_nolock()) ffff8d353787f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787602601.830662:0:13175:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787602601.830666:0:13175:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d35378f5500 x1874436853685248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787602615 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602601.830674:0:13175:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787602601.830688:0:13175:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:1.0:1787602601.830740:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602601.830771:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db1e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602601.830780:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433400 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602601.830783:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db1e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602601.830793:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x3640686da09db1e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602601.830801:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x3640686da09db1e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602601.830807:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787602601.830810:0:7633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787602601.830813:0:7633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787602601.830853:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db1e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602601.830860:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602601.830892:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db1e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602601.830910:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d353d433400/0x3640686da09db1e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db1e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602601.830923:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602601.830925:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602601.830927:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602601.830937:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787602601.830954:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853685504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787602601.831033:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602601.831984:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853685504 00000100:00100000:1.0:1787602601.831995:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853685504 00000100:00100000:1.0:1787602601.832052:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787602601.832062:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3304:x1874436853685504:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787602601.832071:0:5824:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787602601 with bad export cookie 3909239296613002953 00000100:00100000:3.0:1787602601.833846:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1874436853685248:0@lo:38:kworker.0 00010000:00010000:3.0:1787602601.834834:0:13175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db1f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.834851:0:13175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db1f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.834859:0:13175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db1f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.834866:0:13175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db1f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.834887:0:13175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787602601.834895:0:13175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db42c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.834900:0:13175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db42c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.834906:0:13175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db42c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.834912:0:13175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db42c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.834942:0:13175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787602601.834948:0:13175:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787602601.834975:0:13175:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787602601.834979:0:13175:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:3.0:1787602601.834993:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787602601.834999:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db1f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.835007:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3500030e00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:3.0:1787602601.835011:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db1f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.835020:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3640686da09db1f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602601.835027:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3640686da09db1f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602601.835033:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787602601.835035:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787602601.835038:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787602601.835081:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db1f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.835088:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602601.835114:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db1f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.835122:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3500030e00/0x3640686da09db1ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db1f5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.835152:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602601.835155:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db42c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.835162:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3528f20c00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:3.0:1787602601.835165:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db42c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.835172:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3640686da09db42c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602601.835179:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3640686da09db42c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602601.835185:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787602601.835187:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787602601.835189:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787602601.835200:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db42c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.835206:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602601.835228:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db42c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.835235:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3528f20c00/0x3640686da09db425 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3640686da09db42c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602601.835245:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602601.835247:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602601.835255:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602601.835264:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787602601.835283:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853685632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602601.835361:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602601.835425:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853685632 00000100:00100000:3.0:1787602601.835432:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853685632 00000100:00100000:3.0:1787602601.835469:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787602601.835477:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3303:x1874436853685632:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787602601.835484:0:5822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787602601 with bad export cookie 3909239296613002953 00000100:00100000:3.0:1787602601.835528:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3303:x1874436853685632:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (166us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787602601.835536:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787602601.835570:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.126@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787602601.835575:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8d3503e9f000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787602601.835580:0:3303:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1787602601.835692:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602601.840613:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3304:x1874436853685504:12345-0@lo:103:ldlm_bl.0 Request processed in 8545us (9574us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787602601.840628:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787602601.840869:0:3304:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.126@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787602601.854497:0:3303:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.126@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787602601.854505:0:3303:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787602601.854517:0:3303:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d35378f6a00 x1874436853685120/t0(0) o400->MGC192.168.201.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787602616 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602601.854533:0:3303:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d35354db480 x1874436853685504/t0(0) o103->MGC192.168.201.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787602617 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602601.854542:0:3303:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d3534f7ca80 x1874436853685632/t0(0) o103->MGC192.168.201.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787602617 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787602601.854552:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787602601.854556:0:3303:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787602601.854557:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787602601.854626:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:0:1874436853685760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787602601.854651:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3301:1874436853685120:0@lo:400:kworker.0 00000100:00080000:0.0:1787602601.855207:0:3304:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8d3503e9f000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:3.0:1787602601.855286:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8d3503e9f000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787602601.855293:0:3303:0:(import.c:510:import_select_connection()) MGC192.168.201.126@tcp: connect to NID 0@lo last attempt 136 00000100:00080000:3.0:1787602601.855321:0:3303:0:(import.c:624:import_select_connection()) MGC192.168.201.126@tcp: import ffff8d3503e9f000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:3.0:1787602601.855352:0:3303:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3534f7df80 x1874436853685888/t0(0) o250->MGC192.168.201.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787602601.855523:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3300:1874436853685888:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1787602601.855578:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874436853685888 offset 0 length 520: 4 00000100:00100000:3.0:1787602601.855674:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3303:1874436853685632:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1787602601.855711:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787602601.855723:0:13175:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787602601.855729:0:13175:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8d350c9c0000) has no exports 00000020:00080000:3.0:1787602601.855811:0:13175:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8d350c9c0000) has no exports 00000100:00100000:1.0:1787602601.858145:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3304:1874436853685504:0@lo:103:ldlm_bl.0 00000020:01000000:3.0:1787602601.859523:0:13175:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d350548ede0 - data ffff8d353fe43000/ffff8d3535523400 00000020:01000000:3.0:1787602601.860146:0:13175:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d3502d21060 - data ffff8d351c18b798/ffff8d340433d800 00100000:10000000:3.0:1787602601.879540:0:13175:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787602601.921533:0:13175:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09daffd 00000020:00000080:1.0:1787602601.921544:0:13175:0:(genops.c:885:class_export_put()) final put ffff8d3534644800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787602601.921556:0:13175:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d353d79c800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787602601.921559:0:13175:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d353d79c800 2 00000020:01000004:1.0:1787602601.921562:0:13175:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d353d79c800 from lustre-OST0000 00000020:00000080:1.0:1787602601.921590:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787602601.921602:0:13175:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787602601.921605:0:13175:0:(genops.c:885:class_export_put()) final put ffff8d3534816800/lustre-OST0000_UUID 00000020:00000080:1.0:1787602601.921608:0:13175:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3534816800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787602601.921632:0:13175:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787602601.921691:0:13175:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787602601.921696:0:13175:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787602601.921700:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787602601.921705:0:13175:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787602601.921712:0:13175:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d353787e000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787602601.921719:0:13175:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8d34049c4d28) has exports, disconnecting them 00000020:00080000:1.0:1787602601.921724:0:13175:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d353787e000), last request at 1787602371 00000020:00000080:1.0:1787602601.921728:0:13175:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db027 00000020:00080000:1.0:1787602601.921738:0:13175:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d353787e000): rc 0 00000020:00000080:1.0:1787602601.921786:0:13175:0:(genops.c:885:class_export_put()) final put ffff8d353787e000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787602601.922531:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3534644800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787602601.922551:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d353787e000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787602601.923996:0:13175:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787602601.924005:0:13175:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787602601.924010:0:13175:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787602601.924018:0:13175:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787602601.924297:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787602601.924318:0:13175:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787602601.924324:0:13175:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d353d79c800 1 00000020:00000080:0.0:1787602601.924343:0:13175:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09dafb7 00000020:00000080:0.0:1787602601.924350:0:13175:0:(genops.c:885:class_export_put()) final put ffff8d353d25d800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787602601.926141:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d353787f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787602601.926163:0:37:0:(genops.c:885:class_export_put()) final put ffff8d34049c9800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787602601.926166:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d34049c9800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787602601.926176:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787602601.928926:0:13175:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787602601.928947:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787602601.928962:0:13175:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787602601.928969:0:13175:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8d35035c0000) has no exports 00000020:00000080:2.0:1787602601.929664:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d353d25d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787602601.944731:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787602601.944780:0:13175:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787602601.944787:0:13175:0:(genops.c:885:class_export_put()) final put ffff8d353d79b000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787602601.944793:0:13175:0:(genops.c:844:class_export_destroy()) destroying export ffff8d353d79b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787602601.944805:0:13175:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787602601.944949:0:13175:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d353d799800 00000020:02000400:0.0:1787602601.945025:0:13175:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787602602.670013:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602603.695086:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602604.723213:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787602604.808831:0:13325:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787602604.816207:0:13325:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787602604.816271:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db1cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602604.816284:0:13325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db1cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602604.816304:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db1cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602604.816309:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db1cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602604.816352:0:13325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787602604.816358:0:13325:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787602604.816382:0:13325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787602604.816394:0:13325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d35378f6680 x1874436853685376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787602615 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602604.816417:0:13325:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787602604.816423:0:13325:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787602604.816428:0:13325:0:(import.c:65:import_set_state_nolock()) ffff8d3405c71800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787602604.816432:0:13325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787602604.816434:0:13325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d35378f6680 x1874436853685376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787602615 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602604.816439:0:13325:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787602604.816441:0:13325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:3.0:1787602604.816495:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1874436853685376:0@lo:38:kworker.0 00010000:00010000:1.0:1787602604.816661:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602604.816670:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db1cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602604.816678:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432800 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602604.816683:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db1cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602604.816693:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3640686da09db1cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602604.816702:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3640686da09db1cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602604.816708:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787602604.816711:0:7633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787602604.816713:0:7633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787602604.816729:0:7633:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d3503e9f000 00010000:00010000:1.0:1787602604.816740:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3640686da09db1cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602604.816765:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d353d432800/0x3640686da09db1c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3640686da09db1cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602604.816777:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602604.816779:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602604.816781:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602604.817338:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db1d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602604.817346:0:13325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db1d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602604.817350:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db1d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602604.817365:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db1d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602604.817378:0:13325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602604.817384:0:13325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09db41e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602604.817390:0:13325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09db41e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602604.817396:0:13325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db41e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602604.817403:0:13325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3640686da09db41e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602604.817419:0:13325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787602604.817423:0:13325:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787602604.817438:0:13325:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00010000:00010000:1.0:1787602604.817441:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000000:2.0:1787602604.817442:0:13325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787602604.817446:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1787602604.817446:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db1d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787602604.817452:0:13325:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:1.0:1787602604.817452:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703200 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602604.817455:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db1d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787602604.817456:0:13325:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8d353d7919b8) has no exports 00010000:00010000:1.0:1787602604.817462:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3640686da09db1d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602604.817467:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3640686da09db1d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602604.817472:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787602604.817474:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787602604.817476:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00000020:00080000:2.0:1787602604.817481:0:13325:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8d353d7919b8) has no exports 00010000:00010000:1.0:1787602604.817483:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d3503e9f000 00010000:00010000:1.0:1787602604.817485:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3640686da09db1d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602604.817491:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3503703200/0x3640686da09db1d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3640686da09db1d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602604.817506:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602604.817510:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db41e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602604.817515:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a4800 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602604.817518:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3640686da09db41e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602604.817525:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3640686da09db41e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602604.817531:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3640686da09db41e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602604.817536:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787602604.817538:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787602604.817540:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787602604.817544:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d3503e9f000 00010000:00010000:1.0:1787602604.817546:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3640686da09db41e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602604.817553:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d35110a4800/0x3640686da09db417 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3640686da09db41e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602604.817567:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602604.817569:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602604.817571:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602604.818708:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787602604.819067:0:13325:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d35033c47e0 - data ffff8d351c3c2510/ffff8d353d1d1400 00000020:01000000:2.0:1787602604.819203:0:13325:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d350c8e58a0 - data ffff8d353fe835e8/ffff8d3406145400 00100000:10000000:0.0:1787602604.839052:0:13325:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787602604.922528:0:13325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db0c8 00000020:00000080:1.0:1787602604.922544:0:13325:0:(genops.c:885:class_export_put()) final put ffff8d35351e3000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787602604.922588:0:13325:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d35271fb800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787602604.922594:0:13325:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d35271fb800 2 00000020:01000004:1.0:1787602604.922597:0:13325:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d35271fb800 from lustre-OST0001 00000020:00000080:1.0:1787602604.922650:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787602604.922666:0:13325:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787602604.922670:0:13325:0:(genops.c:885:class_export_put()) final put ffff8d35351e7000/lustre-OST0001_UUID 00000020:00000080:1.0:1787602604.922673:0:13325:0:(genops.c:844:class_export_destroy()) destroying export ffff8d35351e7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787602604.922682:0:13325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787602604.922936:0:13325:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 1b36f9a3-2dc4-4d93-bb16-52c7c573162a->MGS 00010000:00010000:1.0:1787602604.923127:0:13325:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3511046a00/0x3640686da09dafda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3640686da09dafe1 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602604.923143:0:13325:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3511046a00/0x3640686da09dafda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3640686da09dafe1 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602604.923149:0:13325:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787602604.923153:0:13325:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787602604.923157:0:13325:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787602604.923177:0:13325:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d3503e9f000 00010000:00010000:1.0:1787602604.923181:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3511046a00/0x3640686da09dafda lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3640686da09dafe1 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602604.923200:0:13325:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d3503703000/0x3640686da09db218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3640686da09db21f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602604.923208:0:13325:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d3503703000/0x3640686da09db218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3640686da09db21f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602604.923214:0:13325:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787602604.923216:0:13325:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787602604.923218:0:13325:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787602604.923228:0:13325:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d3503e9f000 00010000:00010000:1.0:1787602604.923238:0:13325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d3503703000/0x3640686da09db218 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3640686da09db21f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787602604.923259:0:13325:0:(import.c:65:import_set_state_nolock()) ffff8d3503e9f000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787602604.923264:0:13325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787602604.923267:0:13325:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787602604.923269:0:13325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787602604.923274:0:13325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787602604.923290:0:13325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d3534f7df80 x1874436853685888/t0(0) o250->MGC192.168.201.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787602611 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787602604.923305:0:13325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787602604.923308:0:13325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1787602604.924158:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1b36f9a3-2dc4-4d93-bb16-52c7c573162a:3300:1874436853685888:0@lo:250:ptlrpcd_00_02.0 00000020:00000080:0.0:1787602604.924338:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d35351e3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1787602604.925137:0:13325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787602604.925156:0:13325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09daebb 00000020:00000080:1.0:1787602604.925166:0:13325:0:(genops.c:885:class_export_put()) final put ffff8d3503e9f800/1b36f9a3-2dc4-4d93-bb16-52c7c573162a 00000020:01000000:1.0:1787602604.925188:0:13325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.126@tcp (flags='') 00000020:00000080:1.0:1787602604.925200:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787602604.925209:0:13325:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.126@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787602604.925214:0:13325:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8d350c9c3370) has no exports 10000000:01000000:3.0:1787602604.925855:0:5834:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787602604.926091:0:13325:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.126@tcp: client import never connected 00000100:00080000:1.0:1787602604.926096:0:13325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787602604.926100:0:13325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787602604.926104:0:13325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787602604.926107:0:13325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787602604.926150:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787602604.926158:0:13325:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.126@tcp (uuid 1b36f9a3-2dc4-4d93-bb16-52c7c573162a) 00000020:01000000:1.0:1787602604.926167:0:13325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787602604.926172:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787602604.926176:0:13325:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787602604.926185:0:13325:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d3405c70000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787602604.926192:0:13325:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8d34049c19b8) has exports, disconnecting them 00000020:00080000:1.0:1787602604.926197:0:13325:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d3405c70000), last request at 1787602391 00000020:00000080:1.0:1787602604.926222:0:13325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db0f2 00000020:00080000:1.0:1787602604.926238:0:13325:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d3405c70000): rc 0 00000020:00000080:1.0:1787602604.926243:0:13325:0:(genops.c:885:class_export_put()) final put ffff8d3405c70000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787602604.926322:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3503e9f800/1b36f9a3-2dc4-4d93-bb16-52c7c573162a for MGC192.168.201.126@tcp 00000020:00000080:0.0:1787602604.926333:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3503e9f000 for MGC192.168.201.126@tcp 00000020:00000080:0.0:1787602604.926340:0:36:0:(genops.c:885:class_export_put()) final put ffff8d3503e98000/1b36f9a3-2dc4-4d93-bb16-52c7c573162a 00000020:00000080:0.0:1787602604.926342:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3503e98000/1b36f9a3-2dc4-4d93-bb16-52c7c573162a for MGC192.168.201.126@tcp 00000020:01000000:0.0:1787602604.926348:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.126@tcp (1b36f9a3-2dc4-4d93-bb16-52c7c573162a) 00000020:00000080:0.0:1787602604.926621:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d3405c70000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1787602604.927856:0:13325:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787602604.927865:0:13325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787602604.927871:0:13325:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787602604.927881:0:13325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787602604.928064:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d3405c71800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1787602604.928105:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1787602604.928277:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1787602604.928871:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787602604.929170:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d3521caa200:5821] 1 exiting: rc = 0 00000100:00100000:2.0:1787602604.929363:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d3527fd4000:5820] 0 exiting: rc = 1 00000100:00100000:1.0:1787602604.933131:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.936391:0:11167:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d353ccdb600:11167] 3 exiting: rc = 0 00000100:00100000:3.0:1787602604.936568:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d350626de00:5822] 0 exiting: rc = 1 00000100:00100000:1.0:1787602604.937928:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d350349de00:5824] 2 exiting: rc = 0 00000100:00100000:0.0:1787602604.942018:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d350349ce00:5823] 1 exiting: rc = 0 00000100:00100000:1.0:1787602604.942129:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942141:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942148:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942154:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942161:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942168:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942177:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942183:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942189:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942195:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942202:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942209:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942217:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942224:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942231:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942238:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942246:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942252:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942260:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942265:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942271:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942279:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942286:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942320:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942325:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942330:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942337:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942342:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942347:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942353:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942359:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942365:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942371:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942376:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942382:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942387:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942392:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942397:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942402:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942409:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942420:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942425:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942466:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942472:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942478:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942484:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942490:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942496:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942502:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942508:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942513:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942519:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942525:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942531:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942538:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942544:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942550:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942556:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942570:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942576:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942583:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942589:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942594:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.942601:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787602604.943881:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787602604.943896:0:13325:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787602604.943904:0:13325:0:(genops.c:885:class_export_put()) final put ffff8d353e4ac000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787602604.943910:0:13325:0:(genops.c:844:class_export_destroy()) destroying export ffff8d353e4ac000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787602604.943920:0:13325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1787602604.944293:0:13325:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d35271fb800 1 00000020:00000080:1.0:1787602604.944303:0:13325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x3640686da09db097 00000020:00000080:1.0:1787602604.944312:0:13325:0:(genops.c:885:class_export_put()) final put ffff8d353e4a8000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787602604.944366:0:13325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787602604.944374:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787602604.944380:0:13325:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787602604.944386:0:13325:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8d34049c3370) has no exports 00000020:00000080:3.0:1787602604.948928:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d353e4a8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787602604.964178:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787602604.964253:0:13325:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787602604.964260:0:13325:0:(genops.c:885:class_export_put()) final put ffff8d35062b7000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787602604.964267:0:13325:0:(genops.c:844:class_export_destroy()) destroying export ffff8d35062b7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787602604.964279:0:13325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787602604.964632:0:13325:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d35062b5800 00000020:01000000:3.0:1787602604.964661:0:13325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787602604.964666:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787602604.964672:0:13325:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787602604.964676:0:13325:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8d35035c3370) has no exports 00000020:00000080:3.0:1787602604.964717:0:13325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787602604.964723:0:13325:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787602604.964726:0:13325:0:(genops.c:885:class_export_put()) final put ffff8d353d259800/OSS_uuid 00000020:00000080:3.0:1787602604.964728:0:13325:0:(genops.c:844:class_export_destroy()) destroying export ffff8d353d259800/OSS_uuid for OSS 00000020:01000000:3.0:1787602604.964731:0:13325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1787602604.965209:0:5833:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787602604.965374:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8d3505488600:6689] 0 exiting: rc = 1 00000100:00100000:0.0:1787602604.965376:0:8625:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8d350558a800:8625] 3 exiting: rc = 0 00000100:00100000:2.0:1787602604.965477:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8d3503e88400:6690] 1 exiting: rc = 0 00000100:00100000:0.0:1787602604.965513:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8d3503f50000:6691] 2 exiting: rc = 0 00000100:00100000:3.0:1787602604.965857:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965869:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965880:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965891:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965900:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965910:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965918:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965928:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965934:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965939:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965944:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965950:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965955:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965961:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965967:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965973:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965979:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965985:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965991:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.965997:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966003:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966009:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966015:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966020:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966026:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966042:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966048:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966055:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966060:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966067:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966072:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966077:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966264:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966271:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966277:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966283:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966290:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966298:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966304:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966310:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966315:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966321:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966331:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966340:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966345:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966351:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966366:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966373:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966380:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966386:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966393:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966399:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966405:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966415:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966421:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966426:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966431:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966437:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966442:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966447:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966459:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966464:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966470:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.966476:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787602604.970469:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d353d350200:6692] 0 exiting: rc = 1 00000100:00100000:0.0:1787602604.970601:0:10486:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8d353d0f0200:10486] 2 exiting: rc = 0 00000100:00100000:1.0:1787602604.979702:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d353d351600:6693] 1 exiting: rc = 0 00000100:00100000:1.0:1787602604.983892:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.983906:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.983912:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.983919:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.983924:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.983930:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.983936:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.983942:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.983948:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.983953:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.983959:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.983965:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984032:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984042:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984061:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984067:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984074:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984140:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984149:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984155:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984162:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984168:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984175:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984182:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984187:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984193:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984199:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984204:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984210:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984218:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984225:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984230:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984236:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984242:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984249:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984255:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984261:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984267:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984273:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984279:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984285:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984291:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984297:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984303:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984309:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984321:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984331:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984338:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984351:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984363:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984369:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984379:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984386:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984394:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984399:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984406:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984412:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984418:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984424:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984431:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984436:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984443:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984452:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.984459:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602604.985989:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d353d351a00:6696] 2 exiting: rc = 0 00000100:00100000:2.0:1787602604.986180:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d35054efc00:6694] 0 exiting: rc = 1 00000100:00100000:3.0:1787602604.986258:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d353d351800:6695] 1 exiting: rc = 0 00000100:00100000:1.0:1787602604.986380:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986388:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986394:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986402:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986410:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986415:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986432:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986440:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986446:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986453:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986460:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986466:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986472:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986479:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986485:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986492:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986501:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986506:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986516:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986688:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986789:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986795:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986803:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986809:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986816:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986821:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986827:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986833:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986838:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986844:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986850:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986873:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986881:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986889:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986896:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986904:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986912:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986922:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986929:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986940:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986951:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986961:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986977:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986985:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986991:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.986999:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987006:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987012:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987018:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987024:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987031:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987037:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987043:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987049:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987054:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987068:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987093:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987102:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987108:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987115:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987122:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987128:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987134:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.987141:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787602604.998871:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d353d350000:6697] 0 exiting: rc = 1 00000100:00100000:2.0:1787602605.005376:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d35050f2400:6698] 1 exiting: rc = 0 00000100:00100000:3.0:1787602605.006100:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006110:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006116:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006121:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006127:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006137:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006149:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006158:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006168:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006174:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006181:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006191:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006196:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006203:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006209:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006214:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006219:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006225:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006230:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006235:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006239:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006244:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006249:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006253:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006258:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006262:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006267:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006272:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006277:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006295:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006300:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006306:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006311:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006317:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006323:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006328:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006333:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006337:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006342:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006347:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006351:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006356:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006362:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006367:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006371:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006377:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006382:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006387:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006392:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006398:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006403:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006410:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006415:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006420:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006425:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006430:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006435:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006444:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006450:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006455:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006460:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006465:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006471:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.006476:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.009484:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d353490a200:6700] 1 exiting: rc = 0 00000100:00100000:1.0:1787602605.009680:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d353490b000:6699] 0 exiting: rc = 1 00000100:00100000:3.0:1787602605.014023:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.014037:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.014055:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015105:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015124:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015132:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015140:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015150:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015156:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015231:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015239:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015248:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015254:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015260:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015267:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015301:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015309:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015316:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015322:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015330:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015337:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015344:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015352:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015359:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015365:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015372:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015378:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015399:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015407:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015414:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015420:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015427:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015433:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.015439:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017318:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017328:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017335:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017342:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017349:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017386:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017394:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017401:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017407:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017413:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017420:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017427:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017888:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017897:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017903:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017909:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017916:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017941:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017949:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017955:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017962:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017968:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017975:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017991:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.017999:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.018006:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.018013:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.018020:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.018043:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787602605.018062:0:13325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787602605.052900:0:13325:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787602621.211228:0:13941:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787602630.384015:0:14403:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787602630.384021:0:14403:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787602630.384141:0:14403:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d353cc8e000 00000020:01000004:1.0:1787602630.384157:0:14403:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787602630.384166:0:14403:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787602630.384182:0:14403:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d350c9c0000) 00000020:00000080:1.0:1787602630.384208:0:14403:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787602630.423499:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787602630.429594:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787602630.430324:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787602630.430400:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 15: rc = 0 00100000:10000000:3.0:1787602630.430511:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 15: rc = 0 00100000:10000000:3.0:1787602630.430724:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 15: rc = 0 00100000:10000000:3.0:1787602630.431735:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 15: rc = 0 00100000:10000000:3.0:1787602630.432011:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 15: rc = 0 00100000:10000000:3.0:1787602630.432158:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 15: rc = 0 00100000:10000000:3.0:1787602630.432470:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 17: rc = 0 00100000:10000000:3.0:1787602630.436180:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 642: rc = 0 00100000:10000000:3.0:1787602630.436302:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 642: rc = 0 00100000:10000000:3.0:1787602630.440226:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:3.0:1787602630.443268:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 773: rc = 0 00100000:10000000:3.0:1787602630.446308:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 773: rc = 0 00100000:10000000:3.0:1787602630.446627:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1787602630.449573:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 773: rc = 0 00100000:10000000:2.0:1787602630.449931:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1787602630.450206:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1787602630.450459:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 773: rc = 0 00100000:10000000:2.0:1787602630.450723:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1787602630.451017:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 773: rc = 0 00100000:10000000:2.0:1787602630.451340:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 773: rc = 0 00100000:10000000:2.0:1787602630.451593:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 773: rc = 0 00100000:10000000:2.0:1787602630.452061:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 798: rc = 0 00100000:10000000:2.0:1787602630.452335:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 798: rc = 0 00100000:10000000:2.0:1787602630.452588:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 798: rc = 0 00100000:10000000:2.0:1787602630.452891:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 798: rc = 0 00100000:10000000:2.0:1787602630.453137:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 798: rc = 0 00100000:10000000:2.0:1787602630.460795:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 798: rc = 0 00100000:10000000:2.0:1787602630.461282:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 798: rc = 0 00100000:10000000:2.0:1787602630.462799:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 798: rc = 0 00100000:10000000:2.0:1787602630.463231:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 798: rc = 0 00100000:10000000:2.0:1787602630.463471:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 798: rc = 0 00100000:10000000:2.0:1787602630.465101:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 798: rc = 0 00100000:10000000:2.0:1787602630.465409:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 798: rc = 0 00100000:10000000:2.0:1787602630.469352:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 798: rc = 0 00100000:10000000:2.0:1787602630.471139:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 798: rc = 0 00100000:10000000:2.0:1787602630.471456:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 798: rc = 0 00100000:10000000:2.0:1787602630.473334:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 798: rc = 0 00100000:10000000:2.0:1787602630.473659:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 798: rc = 0 00100000:10000000:2.0:1787602630.473962:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 798: rc = 0 00100000:10000000:2.0:1787602630.474241:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 798: rc = 0 00100000:10000000:2.0:1787602630.474530:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 798: rc = 0 00100000:10000000:2.0:1787602630.474836:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 798: rc = 0 00100000:10000000:2.0:1787602630.475100:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 798: rc = 0 00100000:10000000:2.0:1787602630.481399:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 798: rc = 0 00100000:10000000:3.0:1787602630.487251:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 798: rc = 0 00100000:10000000:3.0:1787602630.488990:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 798: rc = 0 00100000:10000000:3.0:1787602630.489256:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 798: rc = 0 00100000:10000000:3.0:1787602630.489508:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 798: rc = 0 00100000:10000000:3.0:1787602630.490468:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 798: rc = 0 00100000:10000000:3.0:1787602630.490784:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 798: rc = 0 00100000:10000000:3.0:1787602630.492040:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 798: rc = 0 00100000:10000000:3.0:1787602630.492359:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 798: rc = 0 00100000:10000000:3.0:1787602630.492609:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 798: rc = 0 00100000:10000000:3.0:1787602630.493738:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 787: rc = 0 00100000:10000000:3.0:1787602630.495710:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787602630.496128:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 643: rc = 0 00100000:10000000:3.0:1787602630.496382:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787602630.496454:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 643: rc = 0 00100000:10000000:3.0:1787602630.496669:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787602630.496771:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 643: rc = 0 00100000:10000000:3.0:1787602630.498306:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787602630.498396:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:3.0:1787602630.500107:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787602630.500212:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:3.0:1787602630.500457:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787602630.501326:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 770: rc = 0 00000020:00000080:3.0:1787602630.505816:0:14403:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787602630.505828:0:14403:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787602630.505844:0:14403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3640686da09dc1c3 00000020:01000004:3.0:1787602630.505981:0:14403:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787602630.505987:0:14403:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787602630.505994:0:14403:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d353cc8e000 from MGS 00000020:01000004:3.0:1787602630.505999:0:14403:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787602630.506014:0:14403:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d35397799b8) 00000020:00000080:3.0:1787602630.506029:0:14403:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787602630.506094:0:14403:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d353cc8e000 from MGS, refs=2 00080000:01000000:3.0:1787602630.506100:0:14403:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787602630.506106:0:14403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3640686da09dc1d1 00000100:00100000:3.0:1787602630.506269:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787602630.506436:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787602630.506442:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787602630.508685:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787602630.508699:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787602630.509795:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787602630.510108:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787602630.510114:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787602630.511203:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787602630.511212:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787602630.515631:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787602630.515650:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787602630.516513:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602630.516599:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602630.516601:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602630.517482:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602630.517491:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602630.517493:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602630.520142:0:14403:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787602630.530824:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787602630.579104:0:14403:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787602630.579123:0:14403:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787602630.579126:0:14403:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787602630.600842:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787602630.617419:0:14403:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787602630.617605:0:14403:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787602630.618170:0:14403:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787602630.619427:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787602630.620021:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787602630.620030:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787602630.642224:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787602630.642240:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787602630.642652:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787602630.642658:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787602630.643424:0:14403:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787602630.643451:0:14403:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.126@tcp' 00000020:01000004:1.0:1787602630.643453:0:14403:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787602630.643482:0:14403:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.126@tcp (typ=mgc) 00000020:00000080:1.0:1787602630.643496:0:14403:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.126@tcp (ffff8d350c9c19b8) 00000020:00000080:1.0:1787602630.643510:0:14403:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787602630.643598:0:14403:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d350c24d800@MGC192.168.201.126@tcp: add connection 192.168.201.126@tcp at head 00010000:00010000:1.0:1787602630.643781:0:14403:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.126@tcp-0 is initialized 00000040:01000000:1.0:1787602630.643787:0:14403:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.126@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787602630.646015:0:14417:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787602630.656881:0:14419:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787602630.656940:0:14403:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.126@tcp (uuid 704a385b-7757-43d8-8441-546b4c8b60c7) 00000020:00000080:0.0:1787602630.656964:0:14403:0:(genops.c:1385:class_connect()) connect: client 704a385b-7757-43d8-8441-546b4c8b60c7, cookie 0x3640686da09dc1df 00000100:00080000:0.0:1787602630.656977:0:14403:0:(import.c:510:import_select_connection()) MGC192.168.201.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787602630.656986:0:14403:0:(import.c:624:import_select_connection()) MGC192.168.201.126@tcp: import ffff8d350c24d800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:0.0:1787602630.657025:0:14403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3405082300 x1874436853686016/t0(0) o250->MGC192.168.201.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787602630.657070:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:704a385b-7757-43d8-8441-546b4c8b60c7:3300:1874436853686016:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787602630.657152:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787602630.657226:0:14403:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 704a385b-7757-43d8-8441-546b4c8b60c7->MGS 00000020:01000004:0.0:1787602630.657248:0:14403:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787602630.657254:0:14403:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787602630.657271:0:14403:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d353d793370) 00000020:00000080:0.0:1787602630.657285:0:14403:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787602630.660676:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853686016 00000100:00100000:2.0:1787602630.660696:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853686016 00000100:00100000:2.0:1787602630.660864:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602630.660875:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3300:x1874436853686016:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787602630.660912:0:14414:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 704a385b-7757-43d8-8441-546b4c8b60c7@0@lo t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:2.0:1787602630.660945:0:14414:0:(genops.c:1385:class_connect()) connect: client 704a385b-7757-43d8-8441-546b4c8b60c7, cookie 0x3640686da09dc1ed 00000100:00080000:2.0:1787602630.661093:0:14414:0:(import.c:65:import_set_state_nolock()) ffff8d3404164000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787602630.661202:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+5:3300:x1874436853686016:12345-0@lo:250:mount.lustre.0 Request processed in 327us (4048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602630.661210:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787602630.661376:0:3300:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787602630.661387:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.126@tcp: connect to target with instance 0 00000100:00080000:1.0:1787602630.661395:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787602630.661400:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787602630.661404:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d350c24d800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787602630.661407:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787602630.661414:0:3300:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787602630.661420:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:704a385b-7757-43d8-8441-546b4c8b60c7:3300:1874436853686016:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787602630.700116:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787602630.700337:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787602630.700344:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787602630.708673:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787602630.708687:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787602630.710144:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787602630.710153:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787602630.710847:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787602630.711036:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787602630.711041:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787602630.713446:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787602630.713460:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787602630.764303:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787602630.765654:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787602630.765664:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787602630.766804:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787602630.766818:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787602630.767434:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787602630.767619:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787602630.767624:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787602630.773288:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787602630.773301:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787602630.774062:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787602630.774320:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787602630.774325:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787602630.775425:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787602630.775436:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787602630.776138:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787602630.776333:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787602630.776346:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787602630.782144:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787602630.782162:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787602630.816309:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787602630.817897:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787602630.817908:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787602630.823031:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787602630.823051:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787602630.824099:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787602630.824109:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787602630.826453:0:14403:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787602630.826483:0:14403:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787602630.826490:0:14403:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787602630.826663:0:14403:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787602630.826704:0:14403:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.126@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787602630.826709:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787602630.826711:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787602630.826712:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602630.826713:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602630.826715:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602630.826716:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602630.826717:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787602630.826718:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787602630.826720:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602630.826722:0:14403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787602630.826725:0:14403:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787602630.826727:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787602630.826728:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787602630.826729:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787602630.826730:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787602630.826731:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787602630.826732:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787602630.826733:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787602630.826734:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787602630.826735:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787602630.826736:0:14403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787602630.826797:0:14403:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787602630.826818:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853686144:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787602630.826906:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602630.826963:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350873b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602630.827212:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853686144 00000100:00100000:2.0:1787602630.827232:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853686144 00000100:00100000:2.0:1787602630.827292:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602630.827303:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+5:14403:x1874436853686144:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787602630.827352:0:14416:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787602630.827355:0:14416:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787602630.827359:0:14416:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787602630.827738:0:14437:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787602630.828132:0:14416:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787602630.830351:0:14438:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787602630.830359:0:14438:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787602630.830362:0:14438:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787602630.830398:0:14438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787602630.831106:0:14416:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787602630.831118:0:14416:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787602630.849904:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+5:14403:x1874436853686144:12345-0@lo:253:mount.lustre.0 Request processed in 22589us (22984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602630.849925:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602630.850041:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853686144:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787602630.850061:0:14403:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787602630.850065:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787602630.850067:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787602630.850069:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602630.850070:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602630.850072:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602630.850073:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602630.850074:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787602630.850076:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787602630.850078:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602630.850079:0:14403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787602630.850104:0:14403:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d353cc8e000 from lustre-MDT0000 10000000:01000000:2.0:1787602630.850136:0:14403:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787602630.850139:0:14403:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787602630.850145:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d350c9c19b8 10000000:01000000:2.0:1787602630.850149:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787602630.850159:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d350c9c19b8 from 1 10000000:01000000:2.0:1787602630.850162:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787602630.850222:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35378e4c00/0x3640686da09dc1f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602630.850233:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35378e4c00/0x3640686da09dc1f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602630.850438:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35378e4c00/0x3640686da09dc1f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602630.850464:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853686272:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787602630.850505:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602630.850591:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503eff3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602630.853585:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853686272 00000100:00100000:0.0:1787602630.853943:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853686272 00000100:00100000:0.0:1787602630.854036:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787602630.854048:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+5:14403:x1874436853686272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602630.854069:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602630.854096:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d35354e3200/0x3640686da09dc1fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc1f4 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602630.854130:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35354e3200/0x3640686da09dc1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc1f4 expref: 6 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602630.854142:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d35354e3200/0x3640686da09dc1fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc1f4 expref: 6 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602630.854153:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e3200, rc 0) 00000100:00100000:0.0:1787602630.854340:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+6:14403:x1874436853686272:12345-0@lo:101:mount.lustre.0 Request processed in 293us (3833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602630.854348:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787602630.854590:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853686272:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787602630.854685:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35378e4c00/0x3640686da09dc1f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc1fb expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602630.854697:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35378e4c00/0x3640686da09dc1f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc1fb expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602630.854800:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853686400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787602630.854864:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602630.854910:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503eff3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602630.855041:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853686400 00000100:00100000:3.0:1787602630.855047:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853686400 00000100:00100000:3.0:1787602630.855081:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602630.855089:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+6:14403:x1874436853686400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602630.855381:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+6:14403:x1874436853686400:12345-0@lo:501:mount.lustre.0 Request processed in 292us (516us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787602630.855388:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787602630.855935:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853686400:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787602630.855974:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787602630.855996:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35378e4c00/0x3640686da09dc1f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc1fb expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602630.856007:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35378e4c00/0x3640686da09dc1f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc1fb expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602630.856017:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d353cc8e000 10000000:01000000:2.0:1787602630.856024:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787602630.856038:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d353cc8e000 10000000:01000000:2.0:1787602630.856041:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787602630.856044:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d353cc8e000 from 1 10000000:01000000:2.0:1787602630.856047:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787602630.856083:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35378e5200/0x3640686da09dc202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602630.856092:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35378e5200/0x3640686da09dc202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602630.856103:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35378e5200/0x3640686da09dc202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602630.856125:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853686528:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787602630.856170:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602630.856214:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503eff3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602630.856504:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853686528 00000100:00100000:3.0:1787602630.856511:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853686528 00000100:00100000:3.0:1787602630.856565:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787602630.856573:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+6:14403:x1874436853686528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787602630.856588:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602630.856673:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d353d432c00/0x3640686da09dc209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc202 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602630.856695:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d432c00/0x3640686da09dc209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc202 expref: 7 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602630.856706:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d353d432c00/0x3640686da09dc209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc202 expref: 7 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602630.856715:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432c00, rc 0) 00000100:00100000:3.0:1787602630.856785:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+7:14403:x1874436853686528:12345-0@lo:101:mount.lustre.0 Request processed in 212us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602630.856792:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787602630.856916:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853686528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787602630.856931:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35378e5200/0x3640686da09dc202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc209 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602630.856940:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35378e5200/0x3640686da09dc202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc209 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602630.856954:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787602630.856965:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35378e5200/0x3640686da09dc202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc209 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602630.856972:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35378e5200/0x3640686da09dc202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc209 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602630.856978:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787602630.856994:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787602630.856999:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d353cc8e000 10000000:01000000:1.0:1787602630.857004:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787602630.857007:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787602630.857009:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787602630.857026:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354eb600/0x3640686da09dc210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602630.857033:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35354eb600/0x3640686da09dc210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602630.857040:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35354eb600/0x3640686da09dc210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602630.857062:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853686656:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787602630.857099:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602630.857117:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35088b0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787602630.857168:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853686656 00000100:00100000:3.0:1787602630.857172:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853686656 00000100:00100000:3.0:1787602630.857201:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787602630.857208:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+7:14403:x1874436853686656:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787602630.857215:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602630.857223:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d353d433600/0x3640686da09dc217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc210 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602630.857236:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d433600/0x3640686da09dc217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc210 expref: 8 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602630.857244:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d353d433600/0x3640686da09dc217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc210 expref: 8 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602630.857321:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433600, rc 0) 00000100:00100000:3.0:1787602630.857359:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+8:14403:x1874436853686656:12345-0@lo:101:mount.lustre.0 Request processed in 152us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602630.857365:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787602630.857507:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853686656:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787602630.857517:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35354eb600/0x3640686da09dc210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc217 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602630.857524:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35354eb600/0x3640686da09dc210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc217 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602630.857570:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853686784:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787602630.857716:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602630.857739:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35088b0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787602630.857917:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853686784 00000100:00100000:2.0:1787602630.857922:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853686784 00000100:00100000:2.0:1787602630.857955:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787602630.857962:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+8:14403:x1874436853686784:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787602630.859189:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+9:14403:x1874436853686784:12345-0@lo:501:mount.lustre.0 Request processed in 1211us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602630.859199:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787602630.859344:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853686784:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787602630.859388:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853686912:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787602630.859433:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602630.859514:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35088b0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787602630.859964:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853686912 00000100:00100000:3.0:1787602630.859973:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853686912 00000100:00100000:3.0:1787602630.860050:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787602630.860062:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+9:14403:x1874436853686912:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787602630.860594:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+9:14403:x1874436853686912:12345-0@lo:503:mount.lustre.0 Request processed in 532us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602630.860611:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787602630.861041:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853686912:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787602630.861455:0:14439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:704a385b-7757-43d8-8441-546b4c8b60c7:14439:1874436853687040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602630.861505:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602630.861697:0:14439:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503eff3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602630.861775:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853687040 00000100:00100000:1.0:1787602630.861781:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853687040 00000100:00100000:1.0:1787602630.861883:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787602630.861893:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+9:14439:x1874436853687040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602630.862195:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+9:14439:x1874436853687040:12345-0@lo:502:llog_process_th.0 Request processed in 303us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602630.862210:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787602630.862502:0:14439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:704a385b-7757-43d8-8441-546b4c8b60c7:14439:1874436853687040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787602630.862703:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602630.862720:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602630.862722:0:14439:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787602630.862728:0:14439:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787602630.862730:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787602630.862773:0:14439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d34049c4d28) 00000020:00000080:2.0:1787602630.862792:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787602630.862799:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787602630.862948:0:14439:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787602630.862956:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3640686da09dc225 00000020:00000080:2.0:1787602630.863208:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787602630.863213:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602630.863218:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602630.863219:0:14439:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787602630.863222:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602630.863225:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602630.863227:0:14439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787602630.863230:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787602630.863238:0:14439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d34049c3370) 00000020:00000080:2.0:1787602630.863247:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787602630.863903:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787602630.863906:0:14439:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787602630.863910:0:14439:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787602630.863918:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787602630.863979:0:14439:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d353cc8e000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787602630.863995:0:14439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d34049c19b8) 00000020:00000080:2.0:1787602630.864004:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787602630.864061:0:14439:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787602630.864068:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3640686da09dc23a 00000020:00000080:2.0:1787602630.864191:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787602630.864198:0:14439:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787602630.864202:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3640686da09dc241 00080000:01000000:2.0:1787602630.864209:0:14439:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787602630.864213:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3640686da09dc248 00010000:00010000:3.0:1787602630.981074:0:14439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787602630.981571:0:14439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787602630.981787:0:14439:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787602630.992130:0:14439:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d3539778000) 00000020:00000080:3.0:1787602630.992157:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787602630.992731:0:14439:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787602630.992772:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3640686da09dc256 00000020:00000080:0.0:1787602630.995580:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787602631.026415:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3640686da09dc25d 00000020:00000080:0.0:1787602631.028237:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787602631.028271:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602631.028281:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602631.028283:0:14439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787602631.028287:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787602631.028290:0:14439:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1787602631.028291:0:14439:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787602631.028293:0:14439:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787602631.028294:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787602631.028296:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602631.028298:0:14439:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787602631.028300:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787602631.028305:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602631.028318:0:14439:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787602631.028324:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787602631.028370:0:14439:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787602631.028390:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602631.028394:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602631.028395:0:14439:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787602631.028398:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787602631.028401:0:14439:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787602631.028405:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602631.028406:0:14439:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787602631.028409:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787602631.028414:0:14439:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.126@tcp to nid 0x20000c0a8c97e (192.168.201.126@tcp) 00000020:01000000:0.0:1787602631.028441:0:14439:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787602631.028444:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787602631.028460:0:14439:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d353d7919b8) 00000020:00000080:0.0:1787602631.028475:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787602631.028480:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787602631.028564:0:14439:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787602631.028569:0:14439:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787602631.028576:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3640686da09dc26b 00010000:00080000:0.0:1787602631.028621:0:14439:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d3502f3e000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.126@tcp at head 00010000:00010000:0.0:1787602631.029684:0:14439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1787602631.031153:0:14439:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787602631.031235:0:14439:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787602631.043770:0:14439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787602631.044228:0:14439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787602631.044302:0:14439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787602631.046029:0:14443:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787602631.046036:0:14443:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787602631.047415:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787602631.047429:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787602631.047476:0:14439:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787602631.047502:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3640686da09dc272 00000100:00080000:3.0:1787602631.049061:0:14439:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787602631.049073:0:14439:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d3502f3e000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:3.0:1787602631.049117:0:14439:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3534f7ca80 x1874436853687168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787602631.049213:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853687168:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787602631.049296:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874436853687168 offset 0 length 520: 4 00000100:00080000:3.0:1787602631.049366:0:14439:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787602631.049453:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602631.049460:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602631.049462:0:14439:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787602631.049465:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787602631.049469:0:14439:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1787602631.049471:0:14439:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787602631.049472:0:14439:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787602631.049474:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787602631.049476:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602631.049478:0:14439:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787602631.049480:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787602631.049485:0:14439:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787602631.049489:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602631.049491:0:14439:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787602631.049493:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787602631.049497:0:14439:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.126@tcp to nid 0x20000c0a8c97e (192.168.201.126@tcp) 00000020:01000000:3.0:1787602631.049528:0:14439:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787602631.049531:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787602631.049548:0:14439:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d353977b370) 00000020:00000080:3.0:1787602631.049566:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787602631.049571:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787602631.051373:0:14439:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787602631.051391:0:14439:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787602631.051403:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3640686da09dc280 00010000:00080000:2.0:1787602631.051439:0:14439:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d3527a94000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.126@tcp at head 00010000:00010000:2.0:1787602631.052081:0:14439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787602631.052295:0:14439:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787602631.052320:0:14439:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787602631.055120:0:14439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787602631.055237:0:14439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787602631.055316:0:14439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787602631.057188:0:14445:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787602631.057195:0:14445:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787602631.058322:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787602631.058335:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787602631.058369:0:14439:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787602631.058389:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3640686da09dc287 00000100:00080000:2.0:1787602631.058400:0:14439:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787602631.058405:0:14439:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d3527a94000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:2.0:1787602631.058444:0:14439:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d35378f6300 x1874436853687296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787602631.058476:0:14439:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787602631.058544:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602631.058549:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602631.058551:0:14439:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787602631.058553:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602631.058557:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602631.058559:0:14439:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787602631.058562:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787602631.058564:0:14439:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787602631.058566:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602631.058569:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602631.058570:0:14439:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787602631.058573:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602631.058575:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602631.058587:0:14439:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000100:00100000:1.0:1787602631.059105:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853687296:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787602631.059167:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874436853687296 offset 0 length 520: 4 00000100:00080000:3.0:1787602631.060437:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787602631.060443:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787602631.060864:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:704a385b-7757-43d8-8441-546b4c8b60c7:3302:1874436853687424:0@lo:400:kworker.0 00000100:00100000:0.0:1787602631.061285:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602631.061414:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853687424 00000100:00100000:3.0:1787602631.061422:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853687424 00000100:00100000:3.0:1787602631.061472:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787602631.061481:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353510c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+9:3302:x1874436853687424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602631.061548:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353510c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+9:3302:x1874436853687424:12345-0@lo:400:kworker.0 Request processed in 67us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602631.061555:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:00000080:2.0:1787602631.061913:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787602631.064486:0:14439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:704a385b-7757-43d8-8441-546b4c8b60c7:14439:1874436853687552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787602631.064580:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602631.064633:0:14439:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3502fd80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602631.064860:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853687552 00000100:00100000:0.0:1787602631.064867:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853687552 00000100:00100000:0.0:1787602631.064914:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787602631.064923:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353510fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+9:14439:x1874436853687552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602631.065399:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353510fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+9:14439:x1874436853687552:12345-0@lo:502:llog_process_th.0 Request processed in 475us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602631.065408:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787602631.065479:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:704a385b-7757-43d8-8441-546b4c8b60c7:3302:1874436853687424:0@lo:400:kworker.0 00000100:00100000:2.0:1787602631.065872:0:14439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:704a385b-7757-43d8-8441-546b4c8b60c7:14439:1874436853687552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787602631.065902:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602631.065909:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602631.065913:0:14439:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787602631.065918:0:14439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787602631.066605:0:14403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787602631.066627:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787602631.066654:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354eb600/0x3640686da09dc210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc217 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602631.066666:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35354eb600/0x3640686da09dc210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc217 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602631.066998:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d353cc8e000 from 1 10000000:01000000:0.0:1787602631.067002:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787602631.067117:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e3000/0x3640686da09dc28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602631.067126:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35354e3000/0x3640686da09dc28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602631.068490:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35354e3000/0x3640686da09dc28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602631.068531:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853687680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787602631.068611:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602631.068653:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edf600 going to sleep for 11 seconds 00000100:00100000:1.0:1787602631.068788:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853687680 00000100:00100000:1.0:1787602631.068796:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853687680 00000100:00100000:1.0:1787602631.068857:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787602631.068868:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353510f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+9:14403:x1874436853687680:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787602631.068883:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602631.068905:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d35354eac00/0x3640686da09dc295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc28e expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602631.068940:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35354eac00/0x3640686da09dc295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc28e expref: 10 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602631.068951:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d35354eac00/0x3640686da09dc295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc28e expref: 10 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602631.068959:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eac00, rc 0) 00000100:00100000:1.0:1787602631.069001:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353510f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+10:14403:x1874436853687680:12345-0@lo:101:mount.lustre.0 Request processed in 134us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602631.069023:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787602631.069308:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853687680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602631.069332:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35354e3000/0x3640686da09dc28e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc295 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602631.069343:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35354e3000/0x3640686da09dc28e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc295 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602631.070064:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853687808:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787602631.070111:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602631.070136:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edf600 going to sleep for 11 seconds 00000100:00100000:1.0:1787602631.070331:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853687808 00000100:00100000:1.0:1787602631.070337:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853687808 00000100:00100000:1.0:1787602631.070378:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787602631.070387:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353510e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+10:14403:x1874436853687808:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787602631.070405:0:14416:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787602631.070411:0:14416:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787602631.070494:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353510e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+10:14403:x1874436853687808:12345-0@lo:256:mount.lustre.0 Request processed in 108us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602631.070501:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787602631.070580:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853687808:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787602631.071399:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787602631.071416:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e3000/0x3640686da09dc28e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc295 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.071427:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35354e3000/0x3640686da09dc28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc295 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602631.071435:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d353cc8e000 from 1 10000000:01000000:2.0:1787602631.071438:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787602631.071473:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35378e5800/0x3640686da09dc29c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.071481:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35378e5800/0x3640686da09dc29c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.071490:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35378e5800/0x3640686da09dc29c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602631.071509:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853687936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787602631.071554:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602631.071594:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3502fd80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602631.072255:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853687936 00000100:00100000:0.0:1787602631.072263:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853687936 00000100:00100000:0.0:1787602631.072314:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787602631.072323:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353510ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+10:14403:x1874436853687936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602631.072336:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602631.072351:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d35354e2c00/0x3640686da09dc2a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc29c expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602631.072374:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35354e2c00/0x3640686da09dc2a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc29c expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602631.072383:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d35354e2c00/0x3640686da09dc2a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc29c expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602631.072392:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2c00, rc 0) 00000100:00100000:0.0:1787602631.072519:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353510ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+11:14403:x1874436853687936:12345-0@lo:101:mount.lustre.0 Request processed in 197us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602631.072527:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787602631.078329:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853687936:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787602631.078372:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35378e5800/0x3640686da09dc29c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc2a3 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.078388:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35378e5800/0x3640686da09dc29c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc2a3 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602631.079712:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853688064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602631.079823:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602631.079892:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3509b1a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602631.080070:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853688064 00000100:00100000:1.0:1787602631.080081:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853688064 00000100:00100000:1.0:1787602631.080145:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787602631.080158:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353510e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+11:14403:x1874436853688064:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787602631.080690:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353510e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+11:14403:x1874436853688064:12345-0@lo:501:mount.lustre.0 Request processed in 533us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602631.080698:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787602631.081103:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853688064:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602631.081168:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405080380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853688192:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787602631.081233:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602631.081272:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edf840 going to sleep for 11 seconds 00000100:00100000:1.0:1787602631.081584:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853688192 00000100:00100000:1.0:1787602631.081591:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853688192 00000100:00100000:1.0:1787602631.081647:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787602631.081655:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+11:14403:x1874436853688192:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787602631.083187:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+11:14403:x1874436853688192:12345-0@lo:503:mount.lustre.0 Request processed in 1512us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602631.083204:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787602631.086148:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405080380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853688192:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787602631.088269:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:704a385b-7757-43d8-8441-546b4c8b60c7:14447:1874436853688320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602631.088452:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602631.088557:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35088b0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787602631.089283:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853688320 00000100:00100000:3.0:1787602631.089295:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853688320 00000100:00100000:3.0:1787602631.089451:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787602631.089463:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+11:14447:x1874436853688320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602631.090146:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+11:14447:x1874436853688320:12345-0@lo:502:llog_process_th.0 Request processed in 682us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602631.090156:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787602631.091934:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:704a385b-7757-43d8-8441-546b4c8b60c7:14447:1874436853688320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787602631.091988:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787602631.092002:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602631.092005:0:14447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787602631.092012:0:14447:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d353cc8e000 00000020:00000080:1.0:1787602631.092015:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787602631.092025:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602631.092028:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602631.092029:0:14447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787602631.092031:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787602631.092033:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602631.092035:0:14447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787602631.092038:0:14447:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d353cc8e000 00000020:00000080:1.0:1787602631.092040:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787602631.092181:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787602631.092187:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602631.092188:0:14447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787602631.092191:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787602631.092193:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602631.092195:0:14447:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787602631.092198:0:14447:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d353cc8e000 00000020:00000080:1.0:1787602631.092200:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787602631.093450:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:704a385b-7757-43d8-8441-546b4c8b60c7:14447:1874436853688448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602631.093535:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602631.093717:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35088b0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787602631.106458:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853688448 00000100:00100000:0.0:1787602631.106474:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853688448 00000100:00100000:1.0:1787602631.107964:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787602631.107983:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+11:14447:x1874436853688448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602631.108343:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+11:14447:x1874436853688448:12345-0@lo:502:llog_process_th.0 Request processed in 364us (14806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602631.108362:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787602631.121631:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:704a385b-7757-43d8-8441-546b4c8b60c7:14447:1874436853688448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787602631.121689:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787602631.121713:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787602631.121716:0:14447:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787602631.121721:0:14447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787602631.122349:0:14403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787602631.122376:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602631.122411:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35378e5800/0x3640686da09dc29c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc2a3 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602631.122422:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35378e5800/0x3640686da09dc29c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc2a3 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602631.122470:0:14403:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787602631.122474:0:14403:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d353cc8e000 10000000:01000000:0.0:1787602631.122477:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d353cc8e000 10000000:01000000:0.0:1787602631.122481:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787602631.122487:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d353cc8e000 from 1 10000000:01000000:0.0:1787602631.122490:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787602631.122530:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e3e00/0x3640686da09dc2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602631.122556:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35354e3e00/0x3640686da09dc2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602631.122566:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35354e3e00/0x3640686da09dc2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602631.122714:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405080380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853688576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787602631.125489:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602631.125553:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602631.125714:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853688576 00000100:00100000:3.0:1787602631.125724:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853688576 00000100:00100000:3.0:1787602631.126045:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787602631.126068:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+11:14403:x1874436853688576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787602631.126087:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602631.126105:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d353d432400/0x3640686da09dc2b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc2aa expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602631.126131:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d432400/0x3640686da09dc2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc2aa expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602631.126143:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d353d432400/0x3640686da09dc2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc2aa expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602631.126153:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432400, rc 0) 00000100:00100000:3.0:1787602631.126209:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+12:14403:x1874436853688576:12345-0@lo:101:mount.lustre.0 Request processed in 144us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602631.126216:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787602631.130686:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405080380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853688576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602631.130719:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35354e3e00/0x3640686da09dc2aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc2b1 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602631.130868:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35354e3e00/0x3640686da09dc2aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc2b1 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602631.130957:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405080380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853688704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602631.131018:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602631.131055:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602631.131960:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853688704 00000100:00100000:3.0:1787602631.131970:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853688704 00000100:00100000:3.0:1787602631.132022:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787602631.132031:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+12:14403:x1874436853688704:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602631.132359:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+12:14403:x1874436853688704:12345-0@lo:501:mount.lustre.0 Request processed in 328us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602631.132367:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787602631.133868:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405080380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853688704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602631.133927:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405080380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853688832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787602631.133984:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602631.134019:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787602631.134192:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853688832 00000100:00100000:3.0:1787602631.134200:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853688832 00000100:00100000:3.0:1787602631.135109:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787602631.135123:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+12:14403:x1874436853688832:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787602631.135357:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+12:14403:x1874436853688832:12345-0@lo:503:mount.lustre.0 Request processed in 237us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602631.135373:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787602631.136044:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405080380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853688832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787602631.136962:0:14451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405080380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:704a385b-7757-43d8-8441-546b4c8b60c7:14451:1874436853688960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602631.137028:0:14451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602631.151563:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853688960 00000100:00100000:1.0:1787602631.151578:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853688960 00000100:00100000:1.0:1787602631.157480:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787602631.157498:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+12:14451:x1874436853688960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787602631.158462:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+12:14451:x1874436853688960:12345-0@lo:502:llog_process_th.0 Request processed in 962us (21427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602631.158473:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787602631.158678:0:14451:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edf000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602631.158712:0:14451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405080380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:704a385b-7757-43d8-8441-546b4c8b60c7:14451:1874436853688960:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787602631.158826:0:14451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787602631.158845:0:14451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d350c9c3370) 00000020:00000080:1.0:1787602631.158867:0:14451:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787602631.158962:0:14451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d353cc8e000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787602631.158966:0:14451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d353cc8e000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787602631.158969:0:14451:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d353cc8e000 4 00010000:00080000:1.0:1787602631.158997:0:14451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d3503e9e800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.126@tcp at head 00010000:00010000:1.0:1787602631.180549:0:14451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1787602631.181369:0:14451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787602631.181417:0:14451:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787602631.181433:0:14451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3640686da09dc2bf 00000100:00080000:1.0:1787602631.181444:0:14451:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787602631.181451:0:14451:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d3503e9e800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:1.0:1787602631.181489:0:14451:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d35354db100 x1874436853689088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787602631.181515:0:14451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787602631.182103:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787602631.182108:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787602631.182864:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874436853689088:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787602631.182940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602631.183402:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853689088 00000100:00100000:1.0:1787602631.183411:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853689088 00000100:00100000:1.0:1787602631.184240:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787602631.184379:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1874436853689088:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787602631.184458:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1874436853689088:12345-0@lo:38:llog_process_th.0 Request processed in 80us (1516us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787602631.184465:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602631.196037:0:14451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:704a385b-7757-43d8-8441-546b4c8b60c7:14451:1874436853689216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787602631.196129:0:14451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602631.196181:0:14451:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602631.196351:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853689216 00000100:00100000:3.0:1787602631.196359:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853689216 00000100:00100000:3.0:1787602631.196407:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787602631.196418:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+12:14451:x1874436853689216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787602631.196675:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+12:14451:x1874436853689216:12345-0@lo:502:llog_process_th.0 Request processed in 258us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602631.196683:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787602631.196957:0:14451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:704a385b-7757-43d8-8441-546b4c8b60c7:14451:1874436853689216:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787602631.196985:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787602631.197108:0:14403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787602631.197127:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787602631.197147:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e3e00/0x3640686da09dc2aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc2b1 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.197159:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35354e3e00/0x3640686da09dc2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc2b1 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787602631.197214:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787602631.197216:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787602631.197217:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602631.197219:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602631.197220:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602631.197222:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602631.197223:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787602631.197225:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787602631.197226:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602631.197227:0:14403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787602631.197231:0:14403:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787602631.197234:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787602631.197235:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787602631.197236:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602631.197237:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602631.197254:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602631.197256:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602631.197257:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787602631.197258:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787602631.197259:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602631.197260:0:14403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787602631.197276:0:14403:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787602631.197287:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853689344:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787602631.197320:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602631.197352:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3506b1d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787602631.197451:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853689344 00000100:00100000:0.0:1787602631.197457:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853689344 00000100:00100000:0.0:1787602631.197492:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787602631.197501:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+12:14403:x1874436853689344:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787602631.197521:0:14416:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787602631.197535:0:14416:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787602631.199389:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787602631.199402:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d3503e9e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787602631.199408:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787602631.199413:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874436853689088:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1787602631.301955:0:14416:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787602631.301996:0:14437:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787602631.302007:0:14437:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787602631.302032:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d35378e5400/0x3640686da09dc2c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.302054:0:14437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d35354eac00/0x3640686da09dc295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc28e expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.302063:0:14437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d35378e5400/0x3640686da09dc2c6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.302109:0:14437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d35354eac00/0x3640686da09dc295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09dc28e expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.302125:0:14437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d35354eac00/0x3640686da09dc295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09dc28e expref: 12 pid: 14414 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602631.302140:0:14437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14437:1874436853689472:0@lo:104: 00000100:00100000:2.0:1787602631.302218:0:14437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602631.302281:0:14437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3506b1d180 going to sleep for 11 seconds 20000000:01000000:0.0:1787602631.302459:0:14416:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787602631.302557:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853689472 00000100:00100000:2.0:1787602631.302566:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853689472 00000100:00100000:2.0:1787602631.302617:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602631.302652:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:704a385b-7757-43d8-8441-546b4c8b60c7+3:14437:x1874436853689472:12345-0@lo:104: 00010000:00010000:2.0:1787602631.302665:0:14404:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d35354e3000/0x3640686da09dc28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dc295 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.302730:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787602631.302739:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:704a385b-7757-43d8-8441-546b4c8b60c7+3:14437:x1874436853689472:12345-0@lo:104: Request processed in 89us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602631.302785:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602631.302831:0:14437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14437:1874436853689472:0@lo:104: 00010000:00010000:0.0:1787602631.302866:0:14437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d35378e5400/0x3640686da09dc2c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.302948:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602631.302956:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d35354e3000/0x3640686da09dc28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dc295 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.302964:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3000 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:2.0:1787602631.302968:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d35354e3000/0x3640686da09dc28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09dc295 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.302976:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d35354e3000/0x3640686da09dc28e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09dc295 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787602631.302984:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d35354e3000/0x3640686da09dc28e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09dc295 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602631.302989:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787602631.303028:0:14410:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d35354e3000/0x3640686da09dc28e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc295 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.303034:0:14410:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787602631.303055:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d35354e3000/0x3640686da09dc28e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc295 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.303073:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d35354e3000/0x3640686da09dc28e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc295 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.303091:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602631.303093:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602631.303094:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602631.303119:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853689600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787602631.303152:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602631.303544:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853689600 00000100:00100000:2.0:1787602631.303551:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853689600 00010000:00010000:2.0:1787602631.303573:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d35354eac00/0x3640686da09dc295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dc28e expref: 13 pid: 14414 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602631.303613:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602631.303629:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704a385b-7757-43d8-8441-546b4c8b60c7+13:3303:x1874436853689600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787602631.303640:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602631.303644:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d35354eac00/0x3640686da09dc295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dc28e expref: 13 pid: 14414 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.303654:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d35354eac00/0x3640686da09dc295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09dc28e expref: 13 pid: 14414 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.303666:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d35354eac00/0x3640686da09dc295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09dc28e expref: 13 pid: 14414 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.303678:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d35378e5400/0x3640686da09dc2c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.303694:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35378e5400/0x3640686da09dc2c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787602631.303707:0:14406:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001701491s 00010000:00010000:2.0:1787602631.303712:0:14406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d35378e5400/0x3640686da09dc2c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.303718:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d35378e5400/0x3640686da09dc2c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.303724:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d35378e5400/0x3640686da09dc2c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.303731:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d35378e5400/0x3640686da09dc2c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.303736:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5400 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602631.303777:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d35378e5400/0x3640686da09dc2c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.303785:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d35378e5400/0x3640686da09dc2c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.303800:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d35378e5400/0x3640686da09dc2c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.304081:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602631.304128:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704a385b-7757-43d8-8441-546b4c8b60c7+12:3303:x1874436853689600:12345-0@lo:103:ldlm_bl.0 Request processed in 507us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602631.304135:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787602631.304186:0:14437:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d35378e5400/0x3640686da09dc2c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.304195:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d35378e5400/0x3640686da09dc2c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602631.304202:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d35378e5400/0x3640686da09dc2c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602631.304597:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853689600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602631.338281:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+11:14403:x1874436853689344:12345-0@lo:253:mount.lustre.0 Request processed in 140762us (140941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602631.338302:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787602631.338530:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:14403:1874436853689344:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787602631.338553:0:14403:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787602631.338558:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787602631.338560:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787602631.338562:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602631.338563:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602631.338564:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602631.338565:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602631.338567:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787602631.338569:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787602631.338571:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602631.338572:0:14403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787602631.338596:0:14403:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787602631.356659:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787602631.356893:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787602631.357211:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787602631.357381:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787602631.357660:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787602631.357856:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787602631.360781:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787602631.361352:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787602631.361638:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787602631.364845:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787602631.365133:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787602631.365319:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787602631.471109:0:14403:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787602631.472191:0:14403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787602631.472631:0:14459:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787602631.472724:0:14459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787602631.482179:0:14459:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787602631.482326:0:14459:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787602631.482332:0:14459:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:3.0:1787602631.482601:0:14458:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787602631.482606:0:14458:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1787602631.483484:0:14403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787602631.493306:0:14403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787602631.494363:0:14403:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787602631.494377:0:14403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787602631.496235:0:14403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787602631.497204:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787602631.497716:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787602631.497779:0:14403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1787602631.506639:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1787602631.523252:0:14403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1787602631.538941:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787602631.590495:0:14403:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787602631.590536:0:14403:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffad9941667988 00100000:10000000:0.0:1787602631.590546:0:14403:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787602631.598699:0:14403:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787602631.598717:0:14403:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787602631.598730:0:14403:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787602631.598783:0:14403:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1787602632.240601:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787602632.556918:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787602632.684982:0:14419:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787602632.684991:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d353cc8e000 from 6 10000000:01000000:0.0:1787602632.684996:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787602632.685042:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e3400/0x3640686da09dc2cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602632.685054:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35354e3400/0x3640686da09dc2cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602632.685068:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35354e3400/0x3640686da09dc2cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602632.685097:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853689728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602632.685181:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602632.685236:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edf480 going to sleep for 11 seconds 00000100:00100000:3.0:1787602632.685288:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853689728 00000100:00100000:3.0:1787602632.685303:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853689728 00000100:00100000:3.0:1787602632.685359:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787602632.685368:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+11:14419:x1874436853689728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602632.685382:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602632.685396:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d353d433e00/0x3640686da09dc2d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc2cd expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602632.685419:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d433e00/0x3640686da09dc2d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc2cd expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602632.685429:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d353d433e00/0x3640686da09dc2d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc2cd expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602632.685439:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433e00, rc 0) 00000100:00100000:3.0:1787602632.685486:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+12:14419:x1874436853689728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602632.685493:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787602632.685667:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853689728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602632.685683:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35354e3400/0x3640686da09dc2cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc2d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602632.685703:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35354e3400/0x3640686da09dc2cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc2d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602632.685801:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853689856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787602632.685832:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602632.685854:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edf480 going to sleep for 11 seconds 00000100:00100000:2.0:1787602632.685902:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853689856 00000100:00100000:2.0:1787602632.685907:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853689856 00000100:00100000:2.0:1787602632.685935:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787602632.685952:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+12:14419:x1874436853689856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787602632.685966:0:14416:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787602632.685984:0:14416:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787602632.685987:0:14416:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787602632.686069:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+12:14419:x1874436853689856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602632.686081:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787602632.686197:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853689856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787602632.686236:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787602632.686244:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e3400/0x3640686da09dc2cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc2d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602632.686251:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35354e3400/0x3640686da09dc2cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc2d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787602633.262601:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787602633.580971:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602634.605330:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602635.641135:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787602636.403278:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787602636.403288:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787602636.403292:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787602636.403296:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787602636.403299:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787602636.403302:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787602636.403308:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d3503e9e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787602636.403329:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d3503e9e800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:2.0:1787602636.403359:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d35378f5c00 x1874436853690112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787602636.404238:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:704a385b-7757-43d8-8441-546b4c8b60c7:3304:1874436853689984:0@lo:400:kworker.0 00000100:00100000:2.0:1787602636.404343:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602636.404398:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853689984 00000100:00100000:3.0:1787602636.404410:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853689984 00000100:00100000:2.0:1787602636.404453:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874436853690112:0@lo:38:kworker.0 00000100:00100000:3.0:1787602636.404472:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787602636.404482:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+12:3304:x1874436853689984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602636.404489:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602636.404543:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+12:3304:x1874436853689984:12345-0@lo:400:kworker.0 Request processed in 62us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602636.404550:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787602636.404556:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:704a385b-7757-43d8-8441-546b4c8b60c7:3304:1874436853689984:0@lo:400:kworker.0 00000100:00100000:1.0:1787602636.404928:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853690112 00000100:00100000:1.0:1787602636.404933:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853690112 00000100:00100000:1.0:1787602636.404955:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602636.404962:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3300:x1874436853690112:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787602636.404989:0:14423:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:1.0:1787602636.405045:0:14423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3640686da09dc2db 00000004:00100000:1.0:1787602636.405063:0:14423:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787602636.405572:0:14423:0:(import.c:65:import_set_state_nolock()) ffff8d340432d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602636.405982:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874436853690112:12345-0@lo:38:kworker.0 Request processed in 1015us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602636.405992:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787602636.407612:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d35378f5c00 x1874436853690112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787602646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787602636.410016:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787602636.410043:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787602636.410053:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787602636.410060:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d3503e9e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787602636.410373:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874436853690112:0@lo:38:kworker.0 00010000:00010000:0.0:1787602636.654267:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602637.680119:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787602638.184207:0:14703:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787602638.701257:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602639.728048:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602640.753558:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602641.516987:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787602631/real 1787602631] req@ffff8d35378f6300 x1874436853687296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787602641 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602641.517044:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d35378f6300 x1874436853687296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787602641 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787602641.517055:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1787602641.517057:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787602631/real 1787602631] req@ffff8d3534f7ca80 x1874436853687168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787602641 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787602641.517064:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787602641.517070:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787602641.517074:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787602641.517079:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d3534f7ca80 x1874436853687168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787602641 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787602641.517101:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d3527a94000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1787602641.517110:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853690368:0@lo:400:kworker.0 00000100:00080000:3.0:1787602641.517117:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787602641.517122:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853687296:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787602641.517129:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d3502f3e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787602641.517135:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787602641.517138:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853687168:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787602641.517207:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602641.517269:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787602641.517276:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:704a385b-7757-43d8-8441-546b4c8b60c7:3302:1874436853690240:0@lo:400:kworker.0 00000100:00100000:1.0:1787602641.517307:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602641.517346:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853690240 00000100:00100000:1.0:1787602641.517354:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853690240 00000100:00100000:1.0:1787602641.517406:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787602641.517416:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+12:3302:x1874436853690240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602641.517479:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+12:3302:x1874436853690240:12345-0@lo:400:kworker.0 Request processed in 64us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602641.517486:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787602641.517518:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787602641.517522:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787602641.517538:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d3502f3e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787602641.517543:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 415 00000100:00080000:1.0:1787602641.517548:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787602641.517554:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d3502f3e000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:1.0:1787602641.517577:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d35354db480 x1874436853690496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787602641.517593:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787602641.517597:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787602641.517599:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d3527a94000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787602641.517615:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 416 00000100:00080000:1.0:1787602641.517617:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787602641.517621:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d3527a94000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:1.0:1787602641.517633:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d35354d8380 x1874436853690624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787602641.517653:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853690496:0@lo:8:kworker.0 00000400:00000100:1.0:1787602641.517674:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874436853690496 offset 0 length 520: 4 00000100:00100000:1.0:1787602641.517688:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853690624:0@lo:8:kworker.0 00000400:00000100:1.0:1787602641.517715:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874436853690624 offset 0 length 520: 4 00000100:00100000:1.0:1787602641.517780:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:704a385b-7757-43d8-8441-546b4c8b60c7:3302:1874436853690240:0@lo:400:kworker.0 00000100:00100000:3.0:1787602641.517987:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853690368 00000100:00100000:3.0:1787602641.517992:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853690368 00000100:00100000:3.0:1787602641.518045:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787602641.518053:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853690368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602641.518095:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853690368:12345-0@lo:400:kworker.0 Request processed in 42us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602641.518101:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787602641.518619:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d35354d8700 x1874436853690368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602641.518632:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853690368:0@lo:400:kworker.0 00010000:00010000:2.0:1787602641.773203:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787602641.830714:0:14853:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff79a81e00 20000000:00000080:3.0:1787602641.830915:0:14853:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d350bd66400 uarg=0000000000000000 20000000:01000000:3.0:1787602641.830964:0:14853:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787602641.830973:0:14853:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787602641.831006:0:14853:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787602641.840713:0:14854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1787602641.846435:0:14853:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787602641.861593:0:14853:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787602641.866566:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d35354ea600/0x3640686da09dc2e2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602641.866620:0:14853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d35354e2c00/0x3640686da09dc2a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc29c expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602641.866631:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d35354ea600/0x3640686da09dc2e2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602641.866690:0:14853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d35354e2c00/0x3640686da09dc2a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09dc29c expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602641.866710:0:14853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d35354e2c00/0x3640686da09dc2a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09dc29c expref: 11 pid: 14414 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602641.866730:0:14853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14853:1874436853690752:0@lo:104: 00000100:00100000:1.0:1787602641.867142:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602641.867221:0:14853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3507937d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787602641.867312:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853690752 00000100:00100000:2.0:1787602641.867324:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853690752 00000100:00100000:2.0:1787602641.867397:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602641.867409:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:704a385b-7757-43d8-8441-546b4c8b60c7+3:14853:x1874436853690752:12345-0@lo:104: 00010000:00010000:2.0:1787602641.867425:0:14404:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d35378e5800/0x3640686da09dc29c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dc2a3 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602641.867540:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787602641.867546:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:704a385b-7757-43d8-8441-546b4c8b60c7+3:14853:x1874436853690752:12345-0@lo:104: Request processed in 140us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602641.867554:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602641.867663:0:14853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14853:1874436853690752:0@lo:104: 00010000:00010000:1.0:1787602641.867689:0:14853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d35354ea600/0x3640686da09dc2e2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602641.870152:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602641.870170:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d35378e5800/0x3640686da09dc29c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dc2a3 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602641.870184:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5800 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:3.0:1787602641.870189:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d35378e5800/0x3640686da09dc29c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09dc2a3 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602641.870201:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d35378e5800/0x3640686da09dc29c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09dc2a3 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602641.870208:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d35378e5800/0x3640686da09dc29c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09dc2a3 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602641.870214:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787602641.880464:0:14410:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d35378e5800/0x3640686da09dc29c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc2a3 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602641.880497:0:14410:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602641.880534:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d35378e5800/0x3640686da09dc29c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc2a3 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602641.880543:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d35378e5800/0x3640686da09dc29c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc2a3 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602641.880589:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602641.880592:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602641.880594:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602641.880831:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602641.880861:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:704a385b-7757-43d8-8441-546b4c8b60c7:3304:1874436853690880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602641.880962:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602641.881346:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853690880 00000100:00100000:0.0:1787602641.881355:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853690880 00010000:00010000:0.0:1787602641.881397:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d35354e2c00/0x3640686da09dc2a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dc29c expref: 12 pid: 14414 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602641.881439:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602641.881448:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704a385b-7757-43d8-8441-546b4c8b60c7+12:3304:x1874436853690880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787602641.881465:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602641.881470:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d35354e2c00/0x3640686da09dc2a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dc29c expref: 12 pid: 14414 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602641.881484:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d35354e2c00/0x3640686da09dc2a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09dc29c expref: 12 pid: 14414 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602641.881502:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d35354e2c00/0x3640686da09dc2a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09dc29c expref: 12 pid: 14414 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602641.881524:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d35354ea600/0x3640686da09dc2e2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602641.881533:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35354ea600/0x3640686da09dc2e2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602641.881551:0:14406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d35354ea600/0x3640686da09dc2e2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602641.881558:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d35354ea600/0x3640686da09dc2e2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602641.881573:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d35354ea600/0x3640686da09dc2e2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602641.881581:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d35354ea600/0x3640686da09dc2e2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602641.881587:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea600 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602641.881592:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d35354ea600/0x3640686da09dc2e2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602641.881601:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d35354ea600/0x3640686da09dc2e2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602641.881623:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d35354ea600/0x3640686da09dc2e2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602641.881635:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602641.881684:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704a385b-7757-43d8-8441-546b4c8b60c7+11:3304:x1874436853690880:12345-0@lo:103:ldlm_bl.0 Request processed in 236us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602641.881693:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602641.882520:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:704a385b-7757-43d8-8441-546b4c8b60c7:3304:1874436853690880:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602641.883903:0:14853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d35354ea600/0x3640686da09dc2e2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602641.883918:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d35354ea600/0x3640686da09dc2e2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602641.883926:0:14853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d35354ea600/0x3640686da09dc2e2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602642.797928:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787602643.309431:0:14419:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787602643.309910:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d353cc8e000 from 10 10000000:01000000:3.0:1787602643.309918:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787602643.310000:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d353d433200/0x3640686da09dc2e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602643.310014:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d353d433200/0x3640686da09dc2e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602643.310029:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d353d433200/0x3640686da09dc2e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602643.310075:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853691008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787602643.310177:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602643.310259:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edf000 going to sleep for 11 seconds 00000100:00100000:2.0:1787602643.310924:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853691008 00000100:00100000:2.0:1787602643.310937:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853691008 00000100:00100000:2.0:1787602643.311012:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787602643.311024:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+11:14419:x1874436853691008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787602643.311044:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602643.311069:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d35378e4e00/0x3640686da09dc2f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc2e9 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602643.311100:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35378e4e00/0x3640686da09dc2f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc2e9 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602643.311112:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d35378e4e00/0x3640686da09dc2f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc2e9 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602643.311124:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e4e00, rc 0) 00000100:00100000:2.0:1787602643.311201:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+12:14419:x1874436853691008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602643.311208:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787602643.313130:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853691008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602643.313168:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d353d433200/0x3640686da09dc2e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc2f0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602643.313192:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d353d433200/0x3640686da09dc2e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc2f0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602643.316088:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853691136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602643.316201:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602643.316262:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edf000 going to sleep for 11 seconds 00000100:00100000:3.0:1787602643.316309:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853691136 00000100:00100000:3.0:1787602643.316318:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853691136 00000100:00100000:3.0:1787602643.316374:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787602643.316384:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+12:14419:x1874436853691136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602643.316724:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+12:14419:x1874436853691136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 339us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602643.316760:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787602643.316824:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853691136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602643.316873:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853691264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602643.316917:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602643.316935:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3534edf000 going to sleep for 11 seconds 00000100:00100000:3.0:1787602643.316951:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853691264 00000100:00100000:3.0:1787602643.316955:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853691264 00000100:00100000:3.0:1787602643.316990:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787602643.316998:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+12:14419:x1874436853691264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602643.317161:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+12:14419:x1874436853691264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602643.317168:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787602643.317209:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853691264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787602643.335949:0:14907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787602643.346173:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787602643.348882:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602643.348909:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d353d433200/0x3640686da09dc2e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc2f0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602643.348927:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d353d433200/0x3640686da09dc2e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc2f0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787602643.502975:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787602643.822771:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602644.852385:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602645.874570:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602646.654387:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1787602646.654411:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787602646.654417:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787602646.654421:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787602646.654424:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787602646.654465:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787602646.654489:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853691520:0@lo:400:kworker.0 00000100:00100000:3.0:1787602646.654594:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602646.654712:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853691520 00000100:00100000:1.0:1787602646.654725:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853691520 00000100:00100000:1.0:1787602646.654820:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602646.654833:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853691520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602646.654900:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853691520:12345-0@lo:400:kworker.0 Request processed in 70us (306us total) trans 0 rc 0/0 00010000:00080000:3.0:1787602646.655057:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d3534f7c380 x1874436853691520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602646.655103:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853691520:0@lo:400:kworker.0 00000100:00100000:1.0:1787602646.655170:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602646.658903:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853691392:0@lo:400:kworker.0 00000100:00100000:2.0:1787602646.659153:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602646.659477:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853691392 00000100:00100000:3.0:1787602646.659488:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853691392 00000100:00100000:3.0:1787602646.659595:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787602646.659608:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+12:3303:x1874436853691392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602646.664956:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+12:3303:x1874436853691392:12345-0@lo:400:kworker.0 Request processed in 5321us (5774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602646.665664:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853691392:0@lo:400:kworker.0 00000100:00100000:3.0:1787602646.667270:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1787602646.893368:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787602647.858439:0:15102:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787602647.858443:0:15102:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787602647.858541:0:15102:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d3534816800 00000020:01000004:2.0:1787602647.858558:0:15102:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787602647.858570:0:15102:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787602647.858585:0:15102:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d34049c0000) 00000020:00000080:2.0:1787602647.858601:0:15102:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787602647.871680:0:15102:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787602647.872122:0:15102:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787602647.873187:0:15102:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787602647.873498:0:15102:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787602647.873713:0:15102:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787602647.874465:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1787602647.874555:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1787602647.874633:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1787602647.875377:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:3.0:1787602647.875735:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 768: rc = 0 00100000:10000000:3.0:1787602647.876338:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:3.0:1787602647.876597:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 768: rc = 0 00100000:10000000:3.0:1787602647.876894:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 768: rc = 0 00100000:10000000:3.0:1787602647.877157:0:15102:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 768: rc = 0 00000020:00000080:3.0:1787602647.878400:0:15102:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787602647.878416:0:15102:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787602647.878436:0:15102:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3640686da09dc2fe 00000020:01000004:3.0:1787602647.878447:0:15102:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787602647.878477:0:15102:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.126@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787602647.878481:0:15102:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787602647.878490:0:15102:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787602647.878495:0:15102:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787602647.878511:0:15102:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d353977cd28) 00000020:00000080:3.0:1787602647.878523:0:15102:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787602647.880632:0:15102:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787602647.880910:0:15102:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787602647.880920:0:15102:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787602647.886091:0:15102:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787602647.886110:0:15102:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787602647.896831:0:15102:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787602647.896854:0:15102:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787602647.899059:0:15102:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787602647.899963:0:15102:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787602647.899970:0:15102:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787602647.902778:0:15102:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787602647.902797:0:15102:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:0.0:1787602647.918014:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602647.924530:0:15102:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787602647.924817:0:15102:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787602647.924824:0:15102:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787602647.933611:0:15102:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787602647.933634:0:15102:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787602647.935210:0:15102:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787602647.935226:0:15102:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787602647.938291:0:15102:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787602647.938569:0:15102:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787602647.938577:0:15102:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787602647.954301:0:15102:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787602647.954318:0:15102:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787602647.988508:0:15102:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787602647.988735:0:15102:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787602647.988759:0:15102:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787602647.991816:0:15102:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787602647.991845:0:15102:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787602647.994174:0:15102:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787602647.994213:0:15102:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787602647.994222:0:15102:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787602648.027653:0:15102:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787602648.027703:0:15102:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.126@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787602648.027708:0:15102:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787602648.027710:0:15102:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787602648.027712:0:15102:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602648.027713:0:15102:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602648.027714:0:15102:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602648.027715:0:15102:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602648.027717:0:15102:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787602648.027720:0:15102:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602648.027721:0:15102:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787602648.027726:0:15102:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787602648.027728:0:15102:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787602648.027730:0:15102:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787602648.027731:0:15102:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602648.027733:0:15102:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602648.027734:0:15102:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602648.027735:0:15102:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602648.027736:0:15102:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787602648.027737:0:15102:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602648.027738:0:15102:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787602648.027817:0:15102:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787602648.027844:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853691648:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787602648.040602:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602648.040680:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a006900 going to sleep for 11 seconds 00000100:00100000:3.0:1787602648.040984:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853691648 00000100:00100000:3.0:1787602648.040997:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853691648 00000100:00100000:3.0:1787602648.041069:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787602648.041081:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+12:15102:x1874436853691648:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787602648.041285:0:14416:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787602648.041289:0:14416:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787602648.041294:0:14416:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787602648.075785:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+12:15102:x1874436853691648:12345-0@lo:253:mount.lustre.0 Request processed in 34661us (35151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602648.075828:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787602648.076171:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853691648:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787602648.076194:0:15102:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787602648.076198:0:15102:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787602648.076200:0:15102:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787602648.076202:0:15102:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602648.076203:0:15102:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602648.076204:0:15102:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602648.076206:0:15102:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602648.076208:0:15102:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787602648.076210:0:15102:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602648.076212:0:15102:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787602648.076237:0:15102:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d3534816800 from lustre-OST0000 10000000:01000000:2.0:1787602648.076281:0:15102:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787602648.076285:0:15102:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787602648.076294:0:15102:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d350c9c19b8 local copy 00010000:00010000:2.0:1787602648.076309:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35378e4c00/0x3640686da09dc1f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc1fb expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602648.076647:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853691776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787602648.076697:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602648.076791:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503e37e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602648.077012:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853691776 00000100:00100000:3.0:1787602648.077021:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853691776 00000100:00100000:3.0:1787602648.077073:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787602648.077084:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+12:15102:x1874436853691776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602648.077295:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+12:15102:x1874436853691776:12345-0@lo:501:mount.lustre.0 Request processed in 212us (596us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787602648.077302:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787602648.077706:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853691776:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787602648.077727:0:15102:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787602648.077981:0:15102:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787602648.077991:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35378e4c00/0x3640686da09dc1f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc1fb expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.078003:0:15102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35378e4c00/0x3640686da09dc1f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc1fb expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602648.078029:0:15102:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d3534816800 10000000:01000000:0.0:1787602648.078035:0:15102:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787602648.078041:0:15102:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d350c9c19b8 10000000:01000000:0.0:1787602648.078043:0:15102:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787602648.078046:0:15102:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d350c9c19b8 from 1 10000000:01000000:0.0:1787602648.078050:0:15102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787602648.078097:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e2c00/0x3640686da09dc30c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.078106:0:15102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35354e2c00/0x3640686da09dc30c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.078348:0:15102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35354e2c00/0x3640686da09dc30c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602648.078370:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853691904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787602648.078415:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602648.078456:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3539774240 going to sleep for 11 seconds 00000100:00100000:3.0:1787602648.080812:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853691904 00000100:00100000:3.0:1787602648.080831:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853691904 00000100:00100000:3.0:1787602648.080949:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787602648.081099:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+12:15102:x1874436853691904:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787602648.081132:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602648.081158:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d353d433800/0x3640686da09dc313 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc30c expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602648.081194:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d433800/0x3640686da09dc313 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc30c expref: 13 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602648.081207:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d353d433800/0x3640686da09dc313 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc30c expref: 13 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602648.081219:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433800, rc 0) 00000100:00100000:3.0:1787602648.081326:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+13:15102:x1874436853691904:12345-0@lo:101:mount.lustre.0 Request processed in 231us (2910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602648.081334:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787602648.081720:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853691904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602648.081775:0:15102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35354e2c00/0x3640686da09dc30c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc313 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.081787:0:15102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35354e2c00/0x3640686da09dc30c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc313 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602648.081817:0:15102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787602648.081834:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e2c00/0x3640686da09dc30c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc313 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.081849:0:15102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35354e2c00/0x3640686da09dc30c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc313 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602648.081858:0:15102:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787602648.081864:0:15102:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787602648.081871:0:15102:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787602648.081902:0:15102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787602648.081940:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e2a00/0x3640686da09dc31a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.081949:0:15102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35354e2a00/0x3640686da09dc31a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.082203:0:15102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35354e2a00/0x3640686da09dc31a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602648.082229:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853692032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787602648.082274:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602648.082321:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3539774240 going to sleep for 11 seconds 00000100:00100000:2.0:1787602648.082469:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853692032 00000100:00100000:2.0:1787602648.082477:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853692032 00000100:00100000:2.0:1787602648.082526:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787602648.082536:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+13:15102:x1874436853692032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787602648.082548:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602648.082562:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d35378e5a00/0x3640686da09dc321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc31a expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.082592:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35378e5a00/0x3640686da09dc321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc31a expref: 14 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.082601:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d35378e5a00/0x3640686da09dc321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc31a expref: 14 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.082611:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35378e5a00, rc 0) 00000100:00100000:2.0:1787602648.082657:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+14:15102:x1874436853692032:12345-0@lo:101:mount.lustre.0 Request processed in 123us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602648.082664:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787602648.083313:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853692032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602648.083332:0:15102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35354e2a00/0x3640686da09dc31a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc321 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.083343:0:15102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35354e2a00/0x3640686da09dc31a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc321 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787602648.089599:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787602648.097716:0:15102:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787602648.098141:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787602648.098192:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787602648.098226:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787602648.098272:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787602648.098307:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787602648.098357:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787602648.098425:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787602648.098433:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787602648.098563:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853692160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787602648.098656:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602648.098719:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503e37840 going to sleep for 11 seconds 00000100:00100000:1.0:1787602648.099332:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853692160 00000100:00100000:1.0:1787602648.099343:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853692160 00000100:00100000:1.0:1787602648.099407:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787602648.099418:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+14:15102:x1874436853692160:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787602648.099913:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+14:15102:x1874436853692160:12345-0@lo:501:mount.lustre.0 Request processed in 494us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602648.099922:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787602648.100273:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853692160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602648.100336:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853692288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787602648.100390:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602648.100433:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3539774240 going to sleep for 11 seconds 00000100:00100000:1.0:1787602648.100779:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853692288 00000100:00100000:1.0:1787602648.100787:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853692288 00000100:00100000:1.0:1787602648.100832:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787602648.100853:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+14:15102:x1874436853692288:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787602648.101607:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+14:15102:x1874436853692288:12345-0@lo:503:mount.lustre.0 Request processed in 764us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602648.101617:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787602648.101738:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853692288:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787602648.104283:0:15102:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787602648.104426:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853692416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602648.104532:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602648.104590:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3539774240 going to sleep for 11 seconds 00000100:00100000:3.0:1787602648.105473:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853692416 00000100:00100000:3.0:1787602648.105498:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853692416 00000100:00100000:3.0:1787602648.105577:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787602648.105590:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+14:15102:x1874436853692416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787602648.106164:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+14:15102:x1874436853692416:12345-0@lo:502:mount.lustre.0 Request processed in 575us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602648.106175:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787602648.108223:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853692416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787602648.108673:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787602648.108828:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787602648.109297:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787602648.109360:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787602648.109400:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787602648.109436:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787602648.109504:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787602648.109541:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787602648.109575:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787602648.109623:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787602648.109661:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787602648.109709:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787602648.110682:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853692544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602648.110868:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602648.110928:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3539774240 going to sleep for 11 seconds 00000100:00100000:2.0:1787602648.111309:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853692544 00000100:00100000:2.0:1787602648.111320:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853692544 00000100:00100000:2.0:1787602648.111380:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787602648.111392:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+14:15102:x1874436853692544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787602648.111681:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+14:15102:x1874436853692544:12345-0@lo:502:mount.lustre.0 Request processed in 290us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602648.111699:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787602648.111877:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853692544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787602648.112034:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787602648.112050:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1787602648.113656:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787602648.113669:0:15116:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787602648.113677:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787602648.113680:0:15116:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787602648.113687:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787602648.113715:0:15116:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d350c9c4d28) 00000020:00000080:1.0:1787602648.113777:0:15116:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787602648.113786:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787602648.114384:0:15116:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d3534816800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787602648.114397:0:15116:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787602648.114407:0:15116:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3640686da09dc32f 00010000:00010000:2.0:1787602648.123732:0:15116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787602648.124337:0:15116:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787602648.129876:0:15116:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787602648.147194:0:15116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787602648.147211:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602648.147221:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602648.147224:0:15116:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787602648.147232:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787602648.147236:0:15116:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1787602648.147237:0:15116:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787602648.147239:0:15116:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787602648.147240:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787602648.147243:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602648.147244:0:15116:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787602648.147247:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602648.147250:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602648.147252:0:15116:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787602648.147256:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787602648.147258:0:15116:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787602648.147262:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602648.147264:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602648.147266:0:15116:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787602648.147268:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602648.147271:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602648.147272:0:15116:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787602648.147276:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787602648.147366:0:15116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602648.147371:0:15116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602648.147372:0:15116:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787602648.147375:0:15116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1787602648.149558:0:15102:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787602648.149618:0:15102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787602648.149649:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e2a00/0x3640686da09dc31a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc321 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.149665:0:15102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35354e2a00/0x3640686da09dc31a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc321 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602648.149685:0:15102:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3534816800 from 1 10000000:01000000:0.0:1787602648.149689:0:15102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602648.149765:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e3c00/0x3640686da09dc336 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.149774:0:15102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35354e3c00/0x3640686da09dc336 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.149788:0:15102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35354e3c00/0x3640686da09dc336 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602648.149822:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853692672:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787602648.149930:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602648.149992:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3539774840 going to sleep for 11 seconds 00000100:00100000:3.0:1787602648.158322:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853692672 00000100:00100000:3.0:1787602648.158344:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853692672 00000100:00100000:3.0:1787602648.158466:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787602648.158481:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+14:15102:x1874436853692672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787602648.158505:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602648.158530:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d353d433000/0x3640686da09dc33d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc336 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602648.158564:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d433000/0x3640686da09dc33d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc336 expref: 15 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602648.158577:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d353d433000/0x3640686da09dc33d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc336 expref: 15 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602648.158588:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433000, rc 0) 00000100:00100000:3.0:1787602648.158698:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+15:15102:x1874436853692672:12345-0@lo:101:mount.lustre.0 Request processed in 220us (8769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602648.158705:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787602648.158825:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853692672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602648.158862:0:15102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35354e3c00/0x3640686da09dc336 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc33d expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.158873:0:15102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35354e3c00/0x3640686da09dc336 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc33d expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787602648.164892:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787602648.173259:0:15102:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787602648.173651:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787602648.173702:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787602648.173799:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787602648.173809:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787602648.173961:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853692800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787602648.174055:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602648.174115:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853692800 00000100:00100000:1.0:1787602648.174124:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853692800 00000100:00100000:1.0:1787602648.174178:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787602648.174188:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+15:15102:x1874436853692800:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787602648.174460:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+15:15102:x1874436853692800:12345-0@lo:501:mount.lustre.0 Request processed in 271us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602648.174469:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787602648.174524:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350855ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787602648.174550:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853692800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787602648.174588:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853692928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787602648.174630:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602648.174652:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853692928 00000100:00100000:1.0:1787602648.174656:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853692928 00000100:00100000:1.0:1787602648.174678:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787602648.174684:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+15:15102:x1874436853692928:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787602648.174857:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+15:15102:x1874436853692928:12345-0@lo:503:mount.lustre.0 Request processed in 171us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602648.174864:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787602648.176194:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350855ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787602648.176236:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853692928:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787602648.177218:0:15102:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787602648.177329:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853693056:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602648.177413:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602648.177448:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3539774840 going to sleep for 11 seconds 00000100:00100000:3.0:1787602648.178417:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853693056 00000100:00100000:3.0:1787602648.178429:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853693056 00000100:00100000:3.0:1787602648.178483:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787602648.178494:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+15:15102:x1874436853693056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787602648.178810:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+15:15102:x1874436853693056:12345-0@lo:502:mount.lustre.0 Request processed in 316us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602648.178819:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787602648.179798:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853693056:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787602648.180159:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787602648.180225:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787602648.180305:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787602648.180342:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787602648.180799:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787602648.180899:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787602648.180938:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787602648.181158:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787602648.181220:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853693184:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602648.181313:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602648.181438:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3539774840 going to sleep for 11 seconds 00000100:00100000:3.0:1787602648.181660:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853693184 00000100:00100000:3.0:1787602648.181669:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853693184 00000100:00100000:3.0:1787602648.181734:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787602648.181770:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+15:15102:x1874436853693184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787602648.182409:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+15:15102:x1874436853693184:12345-0@lo:502:mount.lustre.0 Request processed in 664us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602648.182418:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787602648.182650:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853693184:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787602648.183487:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787602648.183506:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787602648.186604:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602648.186626:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602648.186629:0:15120:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787602648.186644:0:15120:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3534816800 00000020:00000080:2.0:1787602648.186647:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787602648.186657:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602648.186659:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602648.186661:0:15120:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787602648.186663:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602648.186665:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602648.186667:0:15120:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787602648.186669:0:15120:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3534816800 00000020:00000080:2.0:1787602648.186671:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787602648.186799:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602648.186803:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602648.186805:0:15120:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787602648.186808:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787602648.186811:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602648.186812:0:15120:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787602648.186816:0:15120:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d3534816800 00000020:00000080:2.0:1787602648.186818:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787602648.186866:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787602648.186870:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602648.186871:0:15120:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787602648.186875:0:15120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787602648.188974:0:15102:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787602648.189022:0:15102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602648.189056:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e3c00/0x3640686da09dc336 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc33d expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.189073:0:15102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35354e3c00/0x3640686da09dc336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc33d expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602648.189143:0:15102:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787602648.189147:0:15102:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d3534816800 10000000:01000000:0.0:1787602648.189151:0:15102:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d3534816800 10000000:01000000:0.0:1787602648.189157:0:15102:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787602648.189164:0:15102:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3534816800 from 1 10000000:01000000:0.0:1787602648.189174:0:15102:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787602648.189222:0:15102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e2e00/0x3640686da09dc344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.189231:0:15102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35354e2e00/0x3640686da09dc344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.189244:0:15102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35354e2e00/0x3640686da09dc344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602648.189274:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853693312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787602648.189377:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602648.189427:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35397740c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602648.190489:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853693312 00000100:00100000:1.0:1787602648.190502:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853693312 00000100:00100000:1.0:1787602648.190570:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787602648.190582:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+15:15102:x1874436853693312:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787602648.190601:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602648.190621:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d35354ea400/0x3640686da09dc34b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc344 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602648.190653:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35354ea400/0x3640686da09dc34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc344 expref: 16 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602648.190666:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d35354ea400/0x3640686da09dc34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc344 expref: 16 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602648.190676:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354ea400, rc 0) 00000100:00100000:1.0:1787602648.190739:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+16:15102:x1874436853693312:12345-0@lo:101:mount.lustre.0 Request processed in 159us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602648.190764:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787602648.192057:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853693312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602648.192087:0:15102:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35354e2e00/0x3640686da09dc344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc34b expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.192101:0:15102:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35354e2e00/0x3640686da09dc344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc34b expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787602648.195627:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787602648.199144:0:15102:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787602648.206548:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787602648.206712:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787602648.206805:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787602648.206873:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787602648.218888:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787602648.219064:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787602648.219455:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787602648.219503:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787602648.220092:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787602648.220934:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787602648.220982:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787602648.221048:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787602648.221087:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787602648.223290:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787602648.226050:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787602648.230121:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787602648.230229:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787602648.230324:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787602648.232993:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787602648.233122:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787602648.233215:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787602648.233256:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787602648.233328:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787602648.235036:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787602648.236348:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787602648.238241:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787602648.239605:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787602648.239690:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787602648.240267:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787602648.240279:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787602648.241177:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853693440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602648.241273:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602648.241338:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35397740c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602648.241387:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853693440 00000100:00100000:2.0:1787602648.241402:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853693440 00000100:00100000:2.0:1787602648.241482:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787602648.241496:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+16:15102:x1874436853693440:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787602648.242537:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+16:15102:x1874436853693440:12345-0@lo:501:mount.lustre.0 Request processed in 1042us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602648.242547:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787602648.242646:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853693440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602648.242703:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853693568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787602648.244121:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602648.244186:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35397740c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602648.244315:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853693568 00000100:00100000:1.0:1787602648.244325:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853693568 00000100:00100000:1.0:1787602648.244396:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787602648.244410:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+16:15102:x1874436853693568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787602648.244726:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+16:15102:x1874436853693568:12345-0@lo:503:mount.lustre.0 Request processed in 318us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602648.244769:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787602648.245345:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853693568:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787602648.246485:0:15102:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787602648.246616:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853693696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602648.246706:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602648.253658:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35397740c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602648.254056:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853693696 00000100:00100000:2.0:1787602648.254074:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853693696 00000100:00100000:2.0:1787602648.254214:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787602648.254227:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+16:15102:x1874436853693696:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787602648.257618:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+16:15102:x1874436853693696:12345-0@lo:502:mount.lustre.0 Request processed in 3386us (10903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602648.257633:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787602648.267002:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853693696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787602648.267723:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787602648.268063:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787602648.268251:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787602648.268331:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787602648.268465:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787602648.268517:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787602648.268570:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787602648.268611:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787602648.268674:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787602648.268712:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787602648.269066:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787602648.269215:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787602648.269255:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787602648.269286:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787602648.269858:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787602648.269930:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787602648.269968:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787602648.270033:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787602648.270083:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787602648.274333:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787602648.274682:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787602648.274729:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787602648.274815:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787602648.274872:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787602648.274923:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787602648.274962:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787602648.276335:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787602648.276473:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787602648.276532:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787602648.276590:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787602648.276632:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787602648.276671:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787602648.276707:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787602648.276779:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787602648.276822:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787602648.278197:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787602648.278285:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787602648.278321:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787602648.278414:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787602648.278448:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787602648.278512:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853693824:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602648.278624:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602648.278694:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35397740c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602648.279046:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853693824 00000100:00100000:1.0:1787602648.279058:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853693824 00000100:00100000:1.0:1787602648.279134:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787602648.279148:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+16:15102:x1874436853693824:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787602648.279519:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+16:15102:x1874436853693824:12345-0@lo:502:mount.lustre.0 Request processed in 375us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602648.279529:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787602648.284738:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853693824:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787602648.284997:0:15102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787602648.285019:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787602648.296533:0:15125:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787602648.296556:0:15125:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d353d790000) 00000020:00000080:0.0:1787602648.296587:0:15125:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787602648.296670:0:15125:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d3534816800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787602648.296674:0:15125:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d3534816800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787602648.296677:0:15125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3534816800 3 00010000:00080000:0.0:1787602648.296714:0:15125:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d3505480800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.126@tcp at head 00010000:00010000:2.0:1787602648.308155:0:15125:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787602648.308374:0:15125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787602648.308431:0:15125:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787602648.308446:0:15125:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3640686da09dc359 00000100:00080000:2.0:1787602648.308457:0:15125:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787602648.308463:0:15125:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d3505480800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:2.0:1787602648.308503:0:15125:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d35378f4a80 x1874436853693952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787602648.308523:0:15125:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787602648.308623:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787602648.308635:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787602648.308639:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787602648.308643:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787602648.308986:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602648.309003:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853694080:0@lo:400:kworker.0 00000100:00100000:1.0:1787602648.309069:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602648.309139:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1874436853693952:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787602648.309167:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602648.309724:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853694080 00000100:00100000:3.0:1787602648.309738:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853694080 00000100:00100000:3.0:1787602648.309820:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853693952 00000100:00100000:3.0:1787602648.309823:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853693952 00000100:00100000:3.0:1787602648.309841:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602648.309852:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853694080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602648.309911:0:14423:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787602648.309923:0:14423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787602648.309983:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853694080:12345-0@lo:400:kworker.0 Request processed in 131us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602648.309992:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602648.310015:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602648.310020:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3300:x1874436853693952:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787602648.310050:0:14422:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 433 last 0 00010000:00080000:1.0:1787602648.310067:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d3534f7c380 x1874436853694080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602648.310084:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853694080:0@lo:400:kworker.0 00000020:00000080:3.0:1787602648.310095:0:14422:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3640686da09dc360 00000004:00100000:3.0:1787602648.310118:0:14422:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787602648.310158:0:14422:0:(import.c:65:import_set_state_nolock()) ffff8d350c264000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787602648.310209:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874436853693952:12345-0@lo:38:llog_process_th.0 Request processed in 186us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602648.310218:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1787602648.310519:0:15125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787602648.310585:0:15102:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787602648.310614:0:15102:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787602648.310632:0:15102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e2e00/0x3640686da09dc344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc34b expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.310658:0:15102:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35354e2e00/0x3640686da09dc344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc34b expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787602648.310709:0:15102:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787602648.310712:0:15102:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787602648.310713:0:15102:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602648.310715:0:15102:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602648.310716:0:15102:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602648.310718:0:15102:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602648.310720:0:15102:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787602648.310723:0:15102:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602648.310725:0:15102:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787602648.310729:0:15102:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787602648.310731:0:15102:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787602648.310733:0:15102:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787602648.310734:0:15102:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602648.310770:0:15102:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602648.310771:0:15102:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602648.310773:0:15102:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602648.310775:0:15102:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787602648.310776:0:15102:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602648.310778:0:15102:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787602648.310804:0:15102:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787602648.310819:0:15102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853694208:0@lo:253:mount.lustre.0 00010000:00080000:1.0:1787602648.311153:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d35378f4a80 x1874436853693952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787602658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602648.311164:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787602648.311173:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787602648.311188:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787602648.311193:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787602648.311197:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d3505480800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787602648.311203:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1874436853693952:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787602648.313061:0:15102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602648.313149:0:15102:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3502fd8900 going to sleep for 11 seconds 00000100:00100000:3.0:1787602648.317984:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853694208 00000100:00100000:3.0:1787602648.317997:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853694208 00000100:00100000:2.0:1787602648.318892:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787602648.318904:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+16:15102:x1874436853694208:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787602648.318953:0:14415:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787602648.318966:0:14415:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787602648.405360:0:14415:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787602648.405379:0:14415:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787602648.405499:0:14437:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787602648.405505:0:14437:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787602648.405536:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d35378e4600/0x3640686da09dc367 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.405571:0:14437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d353d433e00/0x3640686da09dc2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc2cd expref: 16 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.405581:0:14437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d35378e4600/0x3640686da09dc367 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.405623:0:14437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d353d433e00/0x3640686da09dc2d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09dc2cd expref: 16 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.405638:0:14437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d353d433e00/0x3640686da09dc2d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09dc2cd expref: 16 pid: 14415 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602648.405653:0:14437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14437:1874436853694336:0@lo:104: 00000100:00100000:2.0:1787602648.405717:0:14437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602648.405812:0:14437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a0f0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787602648.406224:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853694336 00000100:00100000:0.0:1787602648.406249:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853694336 00000100:00100000:0.0:1787602648.406317:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787602648.406333:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:704a385b-7757-43d8-8441-546b4c8b60c7+3:14437:x1874436853694336:12345-0@lo:104: 00010000:00010000:0.0:1787602648.406354:0:14405:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d35354e3400/0x3640686da09dc2cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dc2d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602648.406470:0:14405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787602648.406477:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:704a385b-7757-43d8-8441-546b4c8b60c7+3:14437:x1874436853694336:12345-0@lo:104: Request processed in 151us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602648.406485:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787602648.406506:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602648.406516:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d35354e3400/0x3640686da09dc2cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dc2d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602648.406526:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3400 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:3.0:1787602648.406529:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d35354e3400/0x3640686da09dc2cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09dc2d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602648.406540:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d35354e3400/0x3640686da09dc2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09dc2d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787602648.406548:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d35354e3400/0x3640686da09dc2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09dc2d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602648.406553:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787602648.406601:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d35354e3400/0x3640686da09dc2cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc2d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602648.406607:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787602648.406630:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d35354e3400/0x3640686da09dc2cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc2d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602648.406638:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d35354e3400/0x3640686da09dc2cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc2d4 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602648.406654:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602648.406656:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602648.406658:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602648.406681:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787602648.407278:0:14437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14437:1874436853694336:0@lo:104: 00010000:00010000:2.0:1787602648.407300:0:14437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d35378e4600/0x3640686da09dc367 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602648.407507:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:704a385b-7757-43d8-8441-546b4c8b60c7:3304:1874436853694464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602648.407553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602648.409095:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853694464 00000100:00100000:2.0:1787602648.409107:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853694464 00010000:00010000:2.0:1787602648.409142:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d353d433e00/0x3640686da09dc2d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dc2cd expref: 17 pid: 14415 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602648.409182:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787602648.409192:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704a385b-7757-43d8-8441-546b4c8b60c7+17:3304:x1874436853694464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787602648.409205:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602648.409212:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d353d433e00/0x3640686da09dc2d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dc2cd expref: 17 pid: 14415 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.409238:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d353d433e00/0x3640686da09dc2d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09dc2cd expref: 17 pid: 14415 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.409257:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d353d433e00/0x3640686da09dc2d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09dc2cd expref: 17 pid: 14415 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.409275:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d35378e4600/0x3640686da09dc367 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.409282:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35378e4600/0x3640686da09dc367 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787602648.409297:0:14406:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003793129s 00010000:00010000:2.0:1787602648.409301:0:14406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d35378e4600/0x3640686da09dc367 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.409308:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d35378e4600/0x3640686da09dc367 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.409315:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d35378e4600/0x3640686da09dc367 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.409322:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d35378e4600/0x3640686da09dc367 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.409328:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4600 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602648.409332:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d35378e4600/0x3640686da09dc367 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.409339:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d35378e4600/0x3640686da09dc367 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.409371:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d35378e4600/0x3640686da09dc367 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602648.409381:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787602648.409415:0:14437:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d35378e4600/0x3640686da09dc367 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602648.409424:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d35378e4600/0x3640686da09dc367 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602648.409430:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d35378e4600/0x3640686da09dc367 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602648.409452:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:704a385b-7757-43d8-8441-546b4c8b60c7+16:3304:x1874436853694464:12345-0@lo:103:ldlm_bl.0 Request processed in 261us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602648.409463:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787602648.409515:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:704a385b-7757-43d8-8441-546b4c8b60c7:3304:1874436853694464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787602648.427125:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+15:15102:x1874436853694208:12345-0@lo:253:mount.lustre.0 Request processed in 108213us (114056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602648.427140:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787602648.427384:0:15102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15102:1874436853694208:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787602648.427412:0:15102:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787602648.427415:0:15102:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787602648.427417:0:15102:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787602648.427418:0:15102:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787602648.427419:0:15102:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787602648.427420:0:15102:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787602648.427421:0:15102:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787602648.427423:0:15102:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787602648.427425:0:15102:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787602648.427426:0:15102:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787602648.427612:0:15102:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787602648.440770:0:15102:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602648.440960:0:15102:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787602648.441130:0:15102:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602648.441293:0:15102:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787602648.441452:0:15102:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787602648.441659:0:15102:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787602648.443215:0:15102:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787602648.563227:0:15102:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787602648.563235:0:15102:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787602648.563266:0:15102:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787602648.563325:0:15102:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787602648.563338:0:15102:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787602648.563367:0:15102:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787602648.942284:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602649.973059:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787602650.348812:0:14419:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787602650.348824:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d353cc8e000 from 7 10000000:01000000:0.0:1787602650.348831:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787602650.348917:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc36e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602650.348932:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc36e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602650.348946:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc36e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602650.349001:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853694592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602650.349102:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602650.349180:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3536ba6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602650.349558:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853694592 00000100:00100000:1.0:1787602650.349569:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853694592 00000100:00100000:1.0:1787602650.349630:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787602650.349641:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+15:14419:x1874436853694592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602650.349659:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602650.349679:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d35354eb000/0x3640686da09dc375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc36e expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602650.349709:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35354eb000/0x3640686da09dc375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc36e expref: 16 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602650.349721:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d35354eb000/0x3640686da09dc375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc36e expref: 16 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602650.349733:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eb000, rc 0) 00000100:00100000:1.0:1787602650.349807:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+16:14419:x1874436853694592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602650.349815:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787602650.349977:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853694592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602650.350001:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc36e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc375 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602650.350012:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc36e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc375 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602650.350080:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853694720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787602650.350118:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602650.350149:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3536ba6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602650.350325:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853694720 00000100:00100000:1.0:1787602650.350349:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853694720 00000100:00100000:1.0:1787602650.350379:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787602650.350387:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+16:14419:x1874436853694720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787602650.350404:0:14415:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787602650.350424:0:14415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787602650.350427:0:14415:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787602650.350527:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+16:14419:x1874436853694720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602650.350535:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787602650.350670:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853694720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787602650.350784:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787602650.350794:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc36e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc375 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602650.350804:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc36e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc375 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602650.991041:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602652.024918:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602653.037077:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787602653.742463:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1787602653.805423:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787602653.805432:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787602653.805436:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787602653.805439:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787602653.805532:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:704a385b-7757-43d8-8441-546b4c8b60c7:3304:1874436853694848:0@lo:400:kworker.0 00000100:00100000:2.0:1787602653.805682:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853695104:0@lo:400:kworker.0 00000100:00100000:0.0:1787602653.807069:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602653.809074:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853694976:0@lo:400:kworker.0 00000100:00100000:0.0:1787602653.809142:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602653.810067:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853694848 00000100:00100000:0.0:1787602653.810079:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853694848 00000100:00100000:0.0:1787602653.810148:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787602653.810160:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+16:3304:x1874436853694848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602653.810231:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+16:3304:x1874436853694848:12345-0@lo:400:kworker.0 Request processed in 73us (3168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602653.810239:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787602653.810303:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:704a385b-7757-43d8-8441-546b4c8b60c7:3304:1874436853694848:0@lo:400:kworker.0 00000100:00100000:2.0:1787602653.810529:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602653.811020:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853694976 00000100:00100000:1.0:1787602653.811028:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853694976 00000100:00100000:1.0:1787602653.811069:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853695104 00000100:00100000:1.0:1787602653.811073:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853695104 00000100:00100000:1.0:1787602653.811113:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602653.811121:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853694976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602653.811187:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853694976:12345-0@lo:400:kworker.0 Request processed in 66us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602653.811194:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602653.811208:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787602653.811215:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853695104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602653.811247:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853695104:12345-0@lo:400:kworker.0 Request processed in 32us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602653.811253:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787602653.811293:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3405080700 x1874436853694976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602653.811308:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853694976:0@lo:400:kworker.0 00010000:00080000:1.0:1787602653.811333:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3405080e00 x1874436853695104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602653.811361:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853695104:0@lo:400:kworker.0 00000100:00080000:3.0:1787602653.814290:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787602654.062327:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602655.105699:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602656.111409:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787602656.422065:0:15471:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787602656.492893:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787602641/real 1787602641] req@ffff8d35354db480 x1874436853690496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787602656 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602656.492930:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d35354db480 x1874436853690496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787602656 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602656.492941:0:3300:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787602641/real 1787602641] req@ffff8d35354d8380 x1874436853690624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787602656 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602656.492953:0:3300:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d35354d8380 x1874436853690624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787602656 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787602656.492973:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d3502f3e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787602656.493058:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787602656.493062:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853690496:0@lo:8:kworker.0 00000100:00080000:1.0:1787602656.493069:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d3527a94000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787602656.493206:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787602656.493212:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787602656.493215:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d3502f3e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787602656.493220:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 426 00000100:00080000:3.0:1787602656.493226:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787602656.493232:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d3502f3e000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:3.0:1787602656.493271:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3534f7f480 x1874436853695360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787602656.493281:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787602656.493284:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787602656.493286:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d3527a94000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787602656.493289:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 426 00000100:00080000:3.0:1787602656.493291:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787602656.493295:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d3527a94000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:3.0:1787602656.493304:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3534f7c700 x1874436853695488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787602656.493430:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853695232:0@lo:400:kworker.0 00000100:00100000:2.0:1787602656.493509:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602656.493818:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602656.493827:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853695616:0@lo:400:kworker.0 00000100:00100000:2.0:1787602656.493855:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602656.493917:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853695616 00000100:00100000:3.0:1787602656.493926:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853695616 00000100:00100000:3.0:1787602656.493978:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787602656.493988:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853695616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602656.494038:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853695616:12345-0@lo:400:kworker.0 Request processed in 52us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602656.494045:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787602656.494150:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3534f7f100 x1874436853695616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602656.494177:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853695616:0@lo:400:kworker.0 00000100:00080000:1.0:1787602656.494270:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787602656.494275:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853690624:0@lo:8:kworker.0 00000100:00100000:1.0:1787602656.494292:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853695360:0@lo:8:kworker.0 00000100:00100000:1.0:1787602656.494339:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602656.494371:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853695488:0@lo:8:kworker.0 00000100:00100000:1.0:1787602656.494389:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602656.494413:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874436853695744:0@lo:400:kworker.0 00000100:00100000:1.0:1787602656.494435:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602656.494486:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853695360 00000100:00100000:2.0:1787602656.494490:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853695360 00000100:00100000:2.0:1787602656.494505:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853695488 00000100:00100000:2.0:1787602656.494508:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853695488 00000100:00100000:2.0:1787602656.494519:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602656.494524:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1874436853695360:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787602656.494548:0:15103:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:2.0:1787602656.494576:0:15103:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3640686da09dc37c 00002000:00100000:2.0:1787602656.494590:0:15103:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d3405c70000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113951 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787602656.494594:0:15103:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787602656.494597:0:15103:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787602656.494962:0:15103:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787602656.494986:0:15103:0:(import.c:65:import_set_state_nolock()) ffff8d3405c75000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787602656.495032:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1874436853695360:12345-0@lo:8:kworker.0 Request processed in 506us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602656.495039:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602656.495052:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602656.495057:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1874436853695488:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787602656.495066:0:15103:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787602656.495091:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1874436853695488:12345-0@lo:8:kworker.0 Request processed in 33us (701us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787602656.495096:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787602656.495484:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3534f7f480 x1874436853695360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787602676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602656.495496:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787602656.495505:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787602656.495514:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787602656.495521:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787602656.495523:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d3502f3e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787602656.495589:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787602656.495594:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853695360:0@lo:8:kworker.0 00000100:00080000:1.0:1787602656.495607:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d3527a94000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787602656.495610:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787602656.495613:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853695488:0@lo:8:kworker.0 00000100:00100000:0.0:1787602656.496045:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853695232 00000100:00100000:0.0:1787602656.497307:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853695232 00000100:00100000:0.0:1787602656.497465:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787602656.497478:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+16:3303:x1874436853695232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602656.497962:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+16:3303:x1874436853695232:12345-0@lo:400:kworker.0 Request processed in 486us (4452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602656.497971:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787602656.498039:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853695744 00000100:00100000:0.0:1787602656.498048:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853695744 00000004:00080000:3.0:1787602656.498203:0:14443:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787602656.498951:0:14443:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 441445206943ns, next at 0ns, rc = 0 00000004:00080000:2.0:1787602656.500281:0:14444:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787602656.500315:0:14444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14444:1874436853696000:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787602656.500403:0:14444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602656.500434:0:14444:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35033650c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602656.500601:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853695872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602656.500636:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602656.500831:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853695232:0@lo:400:kworker.0 00000100:00100000:0.0:1787602656.503792:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787602656.503944:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853695872 00000100:00100000:2.0:1787602656.503958:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853695872 00000100:00100000:2.0:1787602656.504014:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787602656.504024:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874436853695872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602656.504060:0:15107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602656.504141:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874436853695872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (3503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602656.504148:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602656.505260:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874436853695744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602656.505339:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853696000 00000100:00100000:2.0:1787602656.505349:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853696000 00000100:00100000:0.0:1787602656.505379:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874436853695744:12345-0@lo:400:kworker.0 Request processed in 1572us (10941us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602656.505403:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787602656.505413:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787602656.505424:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14444:x1874436853696000:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1787602656.505464:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787602656.505472:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787602656.507510:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d35378f7480 x1874436853695872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602656.507534:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853695872:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787602656.507883:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3534f7c380 x1874436853695744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602656.507894:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874436853695744:0@lo:400:kworker.0 00002000:00080000:2.0:1787602656.508182:0:15103:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787602656.508190:0:15103:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1787602656.508197:0:15103:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1787602656.518363:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.518376:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf7f8982/0x3640686da09dc383 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.518394:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.518399:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.518405:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7f8982/0x3640686da09dc383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.518421:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf7f8982/0x3640686da09dc383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.518439:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf7f8982/0x3640686da09dc383 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.518447:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7f8982/0x3640686da09dc383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.518473:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787602656.525373:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.525386:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee2b6052/0x3640686da09dc38a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.525402:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.525407:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.525413:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee2b6052/0x3640686da09dc38a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.525425:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee2b6052/0x3640686da09dc38a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.525435:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee2b6052/0x3640686da09dc38a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.525443:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee2b6052/0x3640686da09dc38a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.525474:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787602656.525941:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.525947:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000628b4d24/0x3640686da09dc391 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.525955:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.525958:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.525962:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000628b4d24/0x3640686da09dc391 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.525970:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000628b4d24/0x3640686da09dc391 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.525978:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000628b4d24/0x3640686da09dc391 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.525986:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000628b4d24/0x3640686da09dc391 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.525994:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787602656.526349:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00002000:00010000:2.0:1787602656.526369:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787602656.526376:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf7f8982/0x3640686da09dc383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.526378:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f7a555c/0x3640686da09dc398 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.526425:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1787602656.526433:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5e00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.526439:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602656.526443:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf7f8982/0x3640686da09dc383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.526447:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f7a555c/0x3640686da09dc398 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.526470:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf7f8982/0x3640686da09dc383 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.526476:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f7a555c/0x3640686da09dc398 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.526491:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f7a555c/0x3640686da09dc398 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.526505:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f7a555c/0x3640686da09dc398 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.526515:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787602656.526523:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf7f8982/0x3640686da09dc383 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.526791:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf7f8982/0x3640686da09dc383 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.526830:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787602656.526835:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee2b6052/0x3640686da09dc38a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.526843:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4200 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602656.526848:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee2b6052/0x3640686da09dc38a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.526870:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee2b6052/0x3640686da09dc38a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.526884:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee2b6052/0x3640686da09dc38a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.526893:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee2b6052/0x3640686da09dc38a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.526909:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787602656.526913:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000628b4d24/0x3640686da09dc391 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.526920:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4800 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602656.526924:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000628b4d24/0x3640686da09dc391 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.526932:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000628b4d24/0x3640686da09dc391 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.526943:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000628b4d24/0x3640686da09dc391 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.526951:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000628b4d24/0x3640686da09dc391 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.526984:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602656.526988:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f7a555c/0x3640686da09dc398 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.526996:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5800 already unused, calling callback (ffffffffc1656230) 00002000:00010000:2.0:1787602656.526997:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787602656.527001:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f7a555c/0x3640686da09dc398 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.527007:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dc39f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.527019:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f7a555c/0x3640686da09dc398 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.527024:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.527042:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602656.527047:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f7a555c/0x3640686da09dc398 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.527049:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dc39f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.527070:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dc39f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.527079:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dc39f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.527093:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dc39f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.527101:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787602656.527482:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.527488:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000012dd118/0x3640686da09dc3a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.527497:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.527500:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.527504:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000012dd118/0x3640686da09dc3a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.527512:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000012dd118/0x3640686da09dc3a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.527519:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000012dd118/0x3640686da09dc3a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.527526:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000012dd118/0x3640686da09dc3a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.527533:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787602656.527663:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f7a555c/0x3640686da09dc398 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.527821:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787602656.527827:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dc39f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.527835:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4a00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602656.527840:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dc39f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.527864:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dc39f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.527881:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dc39f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.527888:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c24f0c0c/0x3640686da09dc39f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.527907:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602656.527911:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000012dd118/0x3640686da09dc3a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.527918:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5c00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602656.527922:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000012dd118/0x3640686da09dc3a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.527930:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000012dd118/0x3640686da09dc3a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.527945:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000012dd118/0x3640686da09dc3a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.527952:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000012dd118/0x3640686da09dc3a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.527982:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602656.527984:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602656.527988:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602656.528020:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.535193:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.535208:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009957f91c/0x3640686da09dc3ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.535232:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.535237:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.535244:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009957f91c/0x3640686da09dc3ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.535259:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009957f91c/0x3640686da09dc3ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.535271:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009957f91c/0x3640686da09dc3ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.535280:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009957f91c/0x3640686da09dc3ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.535305:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787602656.535703:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602656.535720:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009957f91c/0x3640686da09dc3ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.535762:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4000 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602656.535769:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009957f91c/0x3640686da09dc3ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.535782:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009957f91c/0x3640686da09dc3ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.535811:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009957f91c/0x3640686da09dc3ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.535818:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009957f91c/0x3640686da09dc3ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787602656.535826:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.535835:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b47eeda9/0x3640686da09dc3b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.535846:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.535852:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602656.535853:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.535857:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b47eeda9/0x3640686da09dc3b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602656.535858:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602656.535862:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.535876:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b47eeda9/0x3640686da09dc3b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.535899:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b47eeda9/0x3640686da09dc3b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.535906:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b47eeda9/0x3640686da09dc3b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.535937:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787602656.536344:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.536350:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09dc3bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.536359:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.536362:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.536367:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09dc3bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.536376:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09dc3bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.536383:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09dc3bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.536390:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09dc3bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.536427:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787602656.536445:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787602656.536451:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b47eeda9/0x3640686da09dc3b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.536459:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4400 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.536463:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b47eeda9/0x3640686da09dc3b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.536472:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b47eeda9/0x3640686da09dc3b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.536487:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b47eeda9/0x3640686da09dc3b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.536494:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b47eeda9/0x3640686da09dc3b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.536513:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.536516:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09dc3bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.536522:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5600 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.536525:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09dc3bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.536543:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09dc3bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.536553:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09dc3bb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.536561:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e0d1983/0x3640686da09dc3bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.536572:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.536573:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.536575:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.537037:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.537044:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a95ef84e/0x3640686da09dc3c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537052:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.537056:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.537059:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a95ef84e/0x3640686da09dc3c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537067:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a95ef84e/0x3640686da09dc3c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537074:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a95ef84e/0x3640686da09dc3c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537088:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a95ef84e/0x3640686da09dc3c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537103:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602656.537113:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.537117:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a95ef84e/0x3640686da09dc3c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537124:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5000 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.537127:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a95ef84e/0x3640686da09dc3c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537136:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a95ef84e/0x3640686da09dc3c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537148:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a95ef84e/0x3640686da09dc3c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537156:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a95ef84e/0x3640686da09dc3c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537169:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.537170:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.537172:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.537568:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.537581:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a213121/0x3640686da09dc3c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537589:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.537592:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.537595:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a213121/0x3640686da09dc3c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537604:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a213121/0x3640686da09dc3c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537611:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a213121/0x3640686da09dc3c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537618:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a213121/0x3640686da09dc3c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537631:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602656.537640:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.537644:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a213121/0x3640686da09dc3c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537651:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e5400 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.537654:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a213121/0x3640686da09dc3c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537662:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a213121/0x3640686da09dc3c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537683:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a213121/0x3640686da09dc3c9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537690:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a213121/0x3640686da09dc3c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.537703:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.537705:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.537707:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602656.542111:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.548701:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.548713:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009433bfb0/0x3640686da09dc3d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.548729:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.548764:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.548772:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009433bfb0/0x3640686da09dc3d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.548787:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009433bfb0/0x3640686da09dc3d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.548797:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009433bfb0/0x3640686da09dc3d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.548806:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009433bfb0/0x3640686da09dc3d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.548845:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787602656.549829:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.549838:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038ae22c9/0x3640686da09dc3d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.549848:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.549852:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.549857:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038ae22c9/0x3640686da09dc3d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.549866:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038ae22c9/0x3640686da09dc3d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.549875:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038ae22c9/0x3640686da09dc3d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.549882:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038ae22c9/0x3640686da09dc3d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.549901:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787602656.549913:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787602656.549920:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009433bfb0/0x3640686da09dc3d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.549928:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35378e4600 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.549939:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009433bfb0/0x3640686da09dc3d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.549949:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009433bfb0/0x3640686da09dc3d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.549966:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009433bfb0/0x3640686da09dc3d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.549975:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009433bfb0/0x3640686da09dc3d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.549997:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.550000:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038ae22c9/0x3640686da09dc3d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.550007:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703000 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.550010:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038ae22c9/0x3640686da09dc3d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.550017:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038ae22c9/0x3640686da09dc3d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.550027:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038ae22c9/0x3640686da09dc3d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.550035:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038ae22c9/0x3640686da09dc3d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.550056:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.550057:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.550059:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.550496:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.550502:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e03bfe/0x3640686da09dc3de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.550511:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.550514:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.550518:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e03bfe/0x3640686da09dc3de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.550526:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2e03bfe/0x3640686da09dc3de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.550534:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e03bfe/0x3640686da09dc3de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.550540:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e03bfe/0x3640686da09dc3de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.550556:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602656.550564:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.550568:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2e03bfe/0x3640686da09dc3de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.550584:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702c00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.550587:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e03bfe/0x3640686da09dc3de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.550595:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e03bfe/0x3640686da09dc3de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.550606:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2e03bfe/0x3640686da09dc3de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.550614:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2e03bfe/0x3640686da09dc3de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.550626:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.550628:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.550630:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.551060:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.551066:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009426c247/0x3640686da09dc3e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551075:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.551079:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.551082:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009426c247/0x3640686da09dc3e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551091:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009426c247/0x3640686da09dc3e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551103:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009426c247/0x3640686da09dc3e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551110:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009426c247/0x3640686da09dc3e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551124:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602656.551132:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.551135:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009426c247/0x3640686da09dc3e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551141:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703200 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.551144:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009426c247/0x3640686da09dc3e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551152:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009426c247/0x3640686da09dc3e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551163:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009426c247/0x3640686da09dc3e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551170:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009426c247/0x3640686da09dc3e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551181:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.551188:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.551190:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.551519:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.551526:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005990790b/0x3640686da09dc3ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551534:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.551537:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.551542:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005990790b/0x3640686da09dc3ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551550:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005990790b/0x3640686da09dc3ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551558:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005990790b/0x3640686da09dc3ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551564:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005990790b/0x3640686da09dc3ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551576:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602656.551583:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.551585:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005990790b/0x3640686da09dc3ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551591:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702600 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.551594:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005990790b/0x3640686da09dc3ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551612:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005990790b/0x3640686da09dc3ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551622:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005990790b/0x3640686da09dc3ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551629:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005990790b/0x3640686da09dc3ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.551640:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.551642:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.551643:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602656.551801:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.557867:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.557882:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b75a349/0x3640686da09dc3f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.557900:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.557905:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.557912:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b75a349/0x3640686da09dc3f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.557927:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b75a349/0x3640686da09dc3f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.557940:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b75a349/0x3640686da09dc3f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.557957:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b75a349/0x3640686da09dc3f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.557975:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602656.557990:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.557996:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b75a349/0x3640686da09dc3f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.558003:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703400 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.558008:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b75a349/0x3640686da09dc3f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.558016:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b75a349/0x3640686da09dc3f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.558032:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b75a349/0x3640686da09dc3f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.558038:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b75a349/0x3640686da09dc3f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.558054:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.558056:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.558057:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.558643:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.558657:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015bc9585/0x3640686da09dc3fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.558666:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.558670:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.558674:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015bc9585/0x3640686da09dc3fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.558684:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015bc9585/0x3640686da09dc3fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.558693:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015bc9585/0x3640686da09dc3fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.558700:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015bc9585/0x3640686da09dc3fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.558720:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602656.558732:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.558979:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015bc9585/0x3640686da09dc3fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.558986:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703e00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.558991:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015bc9585/0x3640686da09dc3fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.558998:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015bc9585/0x3640686da09dc3fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.559019:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015bc9585/0x3640686da09dc3fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.559026:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015bc9585/0x3640686da09dc3fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.559040:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.559042:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.559043:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.559496:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.559503:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8eacede/0x3640686da09dc401 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.559513:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.559516:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.559521:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8eacede/0x3640686da09dc401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.559530:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8eacede/0x3640686da09dc401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.559538:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8eacede/0x3640686da09dc401 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.559546:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8eacede/0x3640686da09dc401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.559575:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602656.559586:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.559591:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8eacede/0x3640686da09dc401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.559598:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702e00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.559602:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8eacede/0x3640686da09dc401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.559610:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8eacede/0x3640686da09dc401 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.559623:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8eacede/0x3640686da09dc401 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.559630:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8eacede/0x3640686da09dc401 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.559644:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.559645:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.559647:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.564912:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.564925:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09dc408 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.564942:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.564955:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.564962:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09dc408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.564977:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09dc408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.564987:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09dc408 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.564994:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09dc408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.565013:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602656.565026:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.565031:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09dc408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.565039:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702200 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.565043:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09dc408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.565051:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09dc408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.565068:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09dc408 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.565087:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d4ef9a7/0x3640686da09dc408 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.565106:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.565108:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.565109:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.571466:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.571481:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003450de46/0x3640686da09dc40f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.571500:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.571504:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.571510:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003450de46/0x3640686da09dc40f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.571524:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003450de46/0x3640686da09dc40f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.571534:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003450de46/0x3640686da09dc40f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.571540:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003450de46/0x3640686da09dc40f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.571562:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602656.571575:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.571587:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003450de46/0x3640686da09dc40f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.571595:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702000 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.571599:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003450de46/0x3640686da09dc40f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.571608:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003450de46/0x3640686da09dc40f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.571623:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003450de46/0x3640686da09dc40f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.571631:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003450de46/0x3640686da09dc40f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.571651:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.571653:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.571654:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.576577:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.576589:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cafe700b/0x3640686da09dc416 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.576606:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.576611:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.576618:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cafe700b/0x3640686da09dc416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.576646:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cafe700b/0x3640686da09dc416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.576657:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cafe700b/0x3640686da09dc416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.576664:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cafe700b/0x3640686da09dc416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.576690:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602656.576708:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.576713:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cafe700b/0x3640686da09dc416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.576721:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703a00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.576726:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cafe700b/0x3640686da09dc416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.580502:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cafe700b/0x3640686da09dc416 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.580543:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cafe700b/0x3640686da09dc416 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.580552:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cafe700b/0x3640686da09dc416 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.580590:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.580592:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.580595:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.581234:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.581242:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a43442ed/0x3640686da09dc41d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581254:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.581259:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.581265:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a43442ed/0x3640686da09dc41d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581277:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a43442ed/0x3640686da09dc41d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581287:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a43442ed/0x3640686da09dc41d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581296:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a43442ed/0x3640686da09dc41d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581314:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602656.581325:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.581330:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a43442ed/0x3640686da09dc41d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581352:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702800 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.581357:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a43442ed/0x3640686da09dc41d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581366:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a43442ed/0x3640686da09dc41d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581377:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a43442ed/0x3640686da09dc41d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581384:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a43442ed/0x3640686da09dc41d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581398:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.581399:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.581401:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.581812:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.581818:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de34fd9f/0x3640686da09dc424 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581827:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.581830:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.581834:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de34fd9f/0x3640686da09dc424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581842:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de34fd9f/0x3640686da09dc424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581858:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de34fd9f/0x3640686da09dc424 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581865:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de34fd9f/0x3640686da09dc424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581880:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602656.581889:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.581893:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de34fd9f/0x3640686da09dc424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581900:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703c00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.581903:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de34fd9f/0x3640686da09dc424 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581910:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de34fd9f/0x3640686da09dc424 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581922:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de34fd9f/0x3640686da09dc424 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581929:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de34fd9f/0x3640686da09dc424 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.581943:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.581950:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.581952:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.582330:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.582335:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc42b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582343:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.582346:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.582350:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc42b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582359:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc42b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582366:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc42b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582373:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc42b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582386:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602656.582393:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.582397:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc42b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582404:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703800 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.582407:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc42b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582426:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc42b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582437:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc42b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582444:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc42b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582455:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.582457:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.582459:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.582879:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.582885:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc432 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582893:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.582897:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.582901:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582911:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582919:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc432 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582937:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582952:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602656.582962:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.582965:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582973:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702400 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.582977:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582984:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.582995:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc432 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.583002:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc432 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.583016:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.583018:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.583020:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787602656.583437:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787602656.583451:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e39eed8d/0x3640686da09dc439 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.583460:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1787602656.583462:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602656.583466:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e39eed8d/0x3640686da09dc439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.583474:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e39eed8d/0x3640686da09dc439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.583482:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e39eed8d/0x3640686da09dc439 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.583489:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e39eed8d/0x3640686da09dc439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.583504:0:15103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602656.583513:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602656.583517:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e39eed8d/0x3640686da09dc439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.583524:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702a00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602656.583528:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e39eed8d/0x3640686da09dc439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.583535:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e39eed8d/0x3640686da09dc439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.583553:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e39eed8d/0x3640686da09dc439 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.583561:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e39eed8d/0x3640686da09dc439 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602656.583575:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.583577:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602656.583578:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787602656.591567:0:15103:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1787602656.591662:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14444:x1874436853696000:12345-0@lo:5:osp-pre-0-0.0 Request processed in 86245us (91255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602656.591674:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787602656.591726:0:14444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14444:1874436853696000:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787602656.591774:0:14444:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787602656.591819:0:14444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14444:1874436853696128:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787602656.591852:0:14444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602656.591889:0:14444:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35033650c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602656.591911:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853696128 00000100:00100000:2.0:1787602656.591917:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853696128 00000100:00100000:2.0:1787602656.591951:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787602656.591959:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14444:x1874436853696128:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787602656.591997:0:15106:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1787602656.608663:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14444:x1874436853696128:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16692us (16798us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787602656.608685:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602656.609005:0:14444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14444:1874436853696128:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787602656.609023:0:14444:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:2.0:1787602656.618058:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787602657.136293:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602658.157896:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787602659.090433:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787602659.090512:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787602659.180988:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602660.207959:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602661.228987:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787602661.998023:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787602661.998044:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787602661.998049:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d3527a94000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787602661.998061:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 441 00000100:00080000:0.0:1787602661.998068:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787602661.998077:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d3527a94000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:0.0:1787602661.998111:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3405080000 x1874436853696512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787602661.998180:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853696384:0@lo:400:kworker.0 00000100:00100000:0.0:1787602661.998278:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602661.998355:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787602661.998362:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:704a385b-7757-43d8-8441-546b4c8b60c7:3304:1874436853696256:0@lo:400:kworker.0 00000100:00100000:0.0:1787602661.998394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602661.998442:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853696384 00000100:00100000:0.0:1787602661.998452:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853696384 00000100:00100000:0.0:1787602661.998519:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602661.998531:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853696384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602661.998593:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405083800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853696384:12345-0@lo:400:kworker.0 Request processed in 64us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602661.998602:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602661.998630:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853696256 00000100:00100000:0.0:1787602661.998635:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853696256 00000100:00100000:0.0:1787602661.998676:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787602661.998684:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+16:3304:x1874436853696256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602661.998715:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+16:3304:x1874436853696256:12345-0@lo:400:kworker.0 Request processed in 32us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602661.998722:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1787602661.998786:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602661.998824:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:704a385b-7757-43d8-8441-546b4c8b60c7:3304:1874436853696256:0@lo:400:kworker.0 00000100:00100000:0.0:1787602661.998837:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787602661.998854:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853696384:0@lo:400:kworker.0 00000100:00100000:0.0:1787602662.001028:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853696512:0@lo:8:kworker.0 00000100:00100000:0.0:1787602662.001135:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602662.001223:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853696512 00000100:00100000:0.0:1787602662.001232:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853696512 00000100:00100000:0.0:1787602662.001276:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787602662.001284:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3300:x1874436853696512:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787602662.001311:0:15106:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787602662.011600:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853696640:0@lo:400:kworker.0 00000100:00100000:1.0:1787602662.011726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602662.011825:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602662.011834:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874436853696768:0@lo:400:kworker.0 00000100:00100000:1.0:1787602662.011879:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602662.012050:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853696640 00000100:00100000:1.0:1787602662.012062:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853696640 00000100:00100000:1.0:1787602662.012129:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853696768 00000100:00100000:1.0:1787602662.012133:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853696768 00000100:00100000:1.0:1787602662.012176:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787602662.012190:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853696640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602662.012258:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853696640:12345-0@lo:400:kworker.0 Request processed in 71us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602662.012266:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787602662.012284:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787602662.012290:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874436853696768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602662.012318:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874436853696768:12345-0@lo:400:kworker.0 Request processed in 28us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602662.012323:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787602662.012691:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3405083480 x1874436853696768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602662.012709:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1874436853696768:0@lo:400:kworker.0 00010000:00080000:1.0:1787602662.012722:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3405083100 x1874436853696640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602662.012731:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853696640:0@lo:400:kworker.0 00000100:00100000:1.0:1787602662.014721:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853696896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602662.014850:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787602662.014951:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602662.016789:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853696896 00000100:00100000:2.0:1787602662.016806:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853696896 00000100:00100000:2.0:1787602662.016881:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602662.016894:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853696896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602662.016950:0:15107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602662.017076:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853696896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (2225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602662.017084:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787602662.017721:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853696896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602662.059079:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3300:x1874436853696512:12345-0@lo:8:kworker.0 Request processed in 57780us (57929us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787602662.059104:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787602662.059181:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d3527a94000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787602662.059188:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787602662.059194:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853696512:0@lo:8:kworker.0 00010000:00010000:0.0:1787602662.258108:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602663.279112:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787602664.003642:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787602664.306103:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787602665.284721:0:15825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787602665.284727:0:15825:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787602665.284900:0:15825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d3505485000 00000020:01000004:0.0:1787602665.284923:0:15825:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787602665.284940:0:15825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787602665.284959:0:15825:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d353d794d28) 00000020:00000080:0.0:1787602665.284980:0:15825:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00010000:00010000:0.0:1787602665.330168:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787602665.338230:0:15825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787602665.338538:0:15825:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787602665.341717:0:15825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787602665.341983:0:15825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787602665.342210:0:15825:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787602665.342541:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 615: rc = 0 00100000:10000000:1.0:1787602665.342721:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 615: rc = 0 00100000:10000000:1.0:1787602665.342860:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 615: rc = 0 00100000:10000000:1.0:1787602665.343287:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 21: rc = 0 00100000:10000000:1.0:1787602665.346777:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 21: rc = 0 00100000:10000000:1.0:1787602665.347161:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 21: rc = 0 00100000:10000000:1.0:1787602665.347442:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 21: rc = 0 00100000:10000000:1.0:1787602665.347721:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 21: rc = 0 00100000:10000000:1.0:1787602665.348029:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 21: rc = 0 00000020:00000080:1.0:1787602665.348732:0:15825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787602665.348784:0:15825:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787602665.348800:0:15825:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3640686da09dc447 00000020:01000004:1.0:1787602665.348811:0:15825:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787602665.348840:0:15825:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.126@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787602665.348844:0:15825:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787602665.348852:0:15825:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787602665.348879:0:15825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787602665.348884:0:15825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787602665.387305:0:15825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787602665.387581:0:15825:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.126@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787602665.387596:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787602665.387598:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787602665.387599:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787602665.387601:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787602665.387602:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787602665.387604:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787602665.387606:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787602665.387607:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787602665.387609:0:15825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787602665.387614:0:15825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787602665.387617:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787602665.387618:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787602665.387619:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787602665.387621:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787602665.387622:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787602665.387623:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787602665.387624:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787602665.387626:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787602665.387627:0:15825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787602665.387684:0:15825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787602665.387711:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405080000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853697024:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787602665.387877:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602665.388130:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343f000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602665.394654:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853697024 00000100:00100000:1.0:1787602665.394699:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853697024 00000100:00100000:1.0:1787602665.394797:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787602665.394810:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+16:15825:x1874436853697024:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787602665.394854:0:14414:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787602665.394857:0:14414:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787602665.394862:0:14414:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787602665.427059:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+16:15825:x1874436853697024:12345-0@lo:253:mount.lustre.0 Request processed in 32236us (39167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602665.427081:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787602665.427241:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405080000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853697024:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787602665.427265:0:15825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787602665.427269:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787602665.427271:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787602665.427273:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787602665.427275:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787602665.427276:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787602665.427278:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787602665.427280:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787602665.427283:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787602665.427284:0:15825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787602665.427333:0:15825:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d3505485000 from lustre-OST0001 10000000:01000000:0.0:1787602665.427383:0:15825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787602665.427388:0:15825:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787602665.427400:0:15825:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d350c9c19b8 local copy 00010000:00010000:0.0:1787602665.427418:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35378e4c00/0x3640686da09dc1f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc1fb expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602665.427825:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405080000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853697152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602665.427873:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602665.427927:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787602665.428155:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853697152 00000100:00100000:2.0:1787602665.428164:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853697152 00000100:00100000:2.0:1787602665.428217:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787602665.428229:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+16:15825:x1874436853697152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787602665.428555:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+16:15825:x1874436853697152:12345-0@lo:501:mount.lustre.0 Request processed in 327us (681us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787602665.428564:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787602665.428793:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405080000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853697152:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787602665.428813:0:15825:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787602665.428995:0:15825:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787602665.429006:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35378e4c00/0x3640686da09dc1f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc1fb expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.429017:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35378e4c00/0x3640686da09dc1f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc1fb expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602665.429051:0:15825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d3505485000 10000000:01000000:1.0:1787602665.429056:0:15825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787602665.429063:0:15825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787602665.429065:0:15825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787602665.429071:0:15825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787602665.429074:0:15825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787602665.429111:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354ea800/0x3640686da09dc44e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.429121:0:15825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35354ea800/0x3640686da09dc44e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.429132:0:15825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35354ea800/0x3640686da09dc44e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602665.429166:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853697280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787602665.429204:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602665.429248:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350341fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787602665.429435:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853697280 00000100:00100000:2.0:1787602665.429442:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853697280 00000100:00100000:2.0:1787602665.429502:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787602665.429519:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+16:15825:x1874436853697280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787602665.429534:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602665.429548:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3503703400/0x3640686da09dc455 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc44e expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602665.429576:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503703400/0x3640686da09dc455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc44e expref: 17 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602665.429604:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3503703400/0x3640686da09dc455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc44e expref: 17 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602665.429615:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503703400, rc 0) 00000100:00100000:2.0:1787602665.429666:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+17:15825:x1874436853697280:12345-0@lo:101:mount.lustre.0 Request processed in 149us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602665.429673:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787602665.429918:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853697280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787602665.429934:0:15825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35354ea800/0x3640686da09dc44e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc455 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.429945:0:15825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35354ea800/0x3640686da09dc44e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc455 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787602665.430911:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787602665.434517:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787602665.435118:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787602665.435179:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787602665.435211:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787602665.435282:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787602665.435317:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787602665.438605:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787602665.439958:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787602665.439977:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787602665.440141:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853697408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602665.440232:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602665.440386:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787602665.446881:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853697408 00000100:00100000:2.0:1787602665.446904:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853697408 00000100:00100000:2.0:1787602665.446991:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787602665.447005:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+17:15825:x1874436853697408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602665.451871:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853697408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602665.451949:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853697536:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787602665.452017:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602665.452068:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602665.452946:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853697536 00000100:00100000:3.0:1787602665.452960:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853697536 00000100:00100000:3.0:1787602665.453073:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787602665.453088:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+18:15825:x1874436853697536:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787602665.453955:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+18:15825:x1874436853697408:12345-0@lo:501:mount.lustre.0 Request processed in 6945us (13715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602665.453967:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787602665.454991:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+17:15825:x1874436853697536:12345-0@lo:503:mount.lustre.0 Request processed in 1898us (2965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602665.455005:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787602665.455329:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853697536:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787602665.456376:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787602665.456494:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853697664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602665.456573:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602665.456635:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602665.458993:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853697664 00000100:00100000:1.0:1787602665.459012:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853697664 00000100:00100000:1.0:1787602665.459082:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787602665.459095:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+17:15825:x1874436853697664:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787602665.460637:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+17:15825:x1874436853697664:12345-0@lo:502:mount.lustre.0 Request processed in 558us (3077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602665.460728:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787602665.462027:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853697664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787602665.463978:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787602665.464086:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787602665.464122:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787602665.464170:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787602665.464209:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787602665.464241:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787602665.464288:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787602665.464325:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787602665.464374:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787602665.464441:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853697792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602665.464568:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602665.464644:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602665.465525:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853697792 00000100:00100000:1.0:1787602665.465540:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853697792 00000100:00100000:1.0:1787602665.465621:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787602665.465632:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+17:15825:x1874436853697792:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787602665.467006:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+17:15825:x1874436853697792:12345-0@lo:502:mount.lustre.0 Request processed in 1368us (2431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602665.467020:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787602665.467836:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853697792:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787602665.468040:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787602665.468062:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1787602665.475066:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787602665.475083:0:15826:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787602665.475092:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787602665.475095:0:15826:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787602665.475103:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787602665.475150:0:15826:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d3405258000) 00000020:00000080:2.0:1787602665.475182:0:15826:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787602665.475196:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787602665.475282:0:15826:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d3505485000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787602665.475292:0:15826:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787602665.475301:0:15826:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3640686da09dc463 00010000:00010000:3.0:1787602665.486457:0:15826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787602665.487078:0:15826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787602665.500349:0:15826:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787602665.502664:0:15826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787602665.502683:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602665.502691:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602665.502693:0:15826:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787602665.502696:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602665.502701:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602665.502703:0:15826:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787602665.502706:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787602665.502708:0:15826:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787602665.502712:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602665.502714:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602665.502716:0:15826:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787602665.502718:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602665.502720:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602665.502722:0:15826:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787602665.502725:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787602665.502842:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602665.502847:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602665.502848:0:15826:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787602665.502852:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1787602665.503124:0:15825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787602665.503166:0:15825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787602665.503192:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354ea800/0x3640686da09dc44e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc455 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602665.503206:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35354ea800/0x3640686da09dc44e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc455 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602665.503215:0:15825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3505485000 from 1 10000000:01000000:0.0:1787602665.503229:0:15825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602665.503278:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e3800/0x3640686da09dc46a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602665.503286:0:15825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35354e3800/0x3640686da09dc46a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602665.503299:0:15825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35354e3800/0x3640686da09dc46a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602665.503329:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853697920:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787602665.503416:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602665.503476:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602665.503809:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853697920 00000100:00100000:1.0:1787602665.503820:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853697920 00000100:00100000:1.0:1787602665.503873:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787602665.503884:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+17:15825:x1874436853697920:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787602665.503899:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602665.503914:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d35354eb800/0x3640686da09dc471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc46a expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.503944:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35354eb800/0x3640686da09dc471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc46a expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.503955:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d35354eb800/0x3640686da09dc471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc46a expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.503966:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354eb800, rc 0) 00000100:00100000:1.0:1787602665.504014:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+18:15825:x1874436853697920:12345-0@lo:101:mount.lustre.0 Request processed in 131us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602665.504021:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787602665.504136:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853697920:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602665.504152:0:15825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35354e3800/0x3640686da09dc46a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc471 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602665.504161:0:15825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35354e3800/0x3640686da09dc46a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc471 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787602665.504814:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787602665.505144:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787602665.505391:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787602665.505430:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787602665.505481:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787602665.505488:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787602665.505561:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853698048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602665.505637:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602665.505678:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787602665.506529:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853698048 00000100:00100000:3.0:1787602665.506565:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853698048 00000100:00100000:3.0:1787602665.506642:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787602665.506663:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+18:15825:x1874436853698048:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787602665.507028:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+18:15825:x1874436853698048:12345-0@lo:501:mount.lustre.0 Request processed in 374us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602665.507037:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787602665.507406:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853698048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602665.507625:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853698176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787602665.507691:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602665.507735:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602665.507815:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853698176 00000100:00100000:1.0:1787602665.507822:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853698176 00000100:00100000:1.0:1787602665.507860:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787602665.507869:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+18:15825:x1874436853698176:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787602665.508239:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+18:15825:x1874436853698176:12345-0@lo:503:mount.lustre.0 Request processed in 370us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602665.508247:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787602665.510702:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853698176:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787602665.511908:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787602665.512027:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853698304:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602665.512141:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602665.512194:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787602665.512473:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853698304 00000100:00100000:1.0:1787602665.512483:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853698304 00000100:00100000:1.0:1787602665.512540:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787602665.512552:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+18:15825:x1874436853698304:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787602665.512917:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+18:15825:x1874436853698304:12345-0@lo:502:mount.lustre.0 Request processed in 366us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602665.512926:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787602665.513118:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853698304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787602665.513418:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787602665.513491:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787602665.513541:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787602665.513579:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787602665.513627:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787602665.513675:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787602665.513709:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787602665.513739:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787602665.513816:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853698432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787602665.513877:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602665.513919:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350887d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602665.514479:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853698432 00000100:00100000:1.0:1787602665.514489:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853698432 00000100:00100000:1.0:1787602665.514539:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787602665.514550:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+18:15825:x1874436853698432:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787602665.514837:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+18:15825:x1874436853698432:12345-0@lo:502:mount.lustre.0 Request processed in 287us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602665.514845:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787602665.516831:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853698432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787602665.517088:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787602665.517108:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787602665.523968:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602665.523986:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602665.523989:0:15830:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787602665.523997:0:15830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3505485000 00000020:00000080:3.0:1787602665.523999:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787602665.524008:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602665.524011:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602665.524025:0:15830:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787602665.524028:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602665.524031:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602665.524033:0:15830:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787602665.524036:0:15830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d3505485000 00000020:00000080:3.0:1787602665.524039:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787602665.524101:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602665.524104:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602665.524106:0:15830:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787602665.524109:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787602665.524112:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602665.524113:0:15830:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787602665.524117:0:15830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d3505485000 00000020:00000080:3.0:1787602665.524119:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787602665.524154:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787602665.524157:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787602665.524159:0:15830:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787602665.524162:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787602665.524230:0:15825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787602665.524292:0:15825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787602665.524313:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e3800/0x3640686da09dc46a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc471 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602665.524328:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35354e3800/0x3640686da09dc46a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc471 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787602665.524376:0:15825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787602665.524380:0:15825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d3505485000 10000000:01000000:3.0:1787602665.524383:0:15825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d3505485000 10000000:01000000:3.0:1787602665.524388:0:15825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787602665.524394:0:15825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d3505485000 from 1 10000000:01000000:3.0:1787602665.524398:0:15825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787602665.527843:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d353d432600/0x3640686da09dc478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602665.527867:0:15825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d353d432600/0x3640686da09dc478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602665.527885:0:15825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d353d432600/0x3640686da09dc478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602665.527935:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853698560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787602665.528042:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602665.528105:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350887d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787602665.532072:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853698560 00000100:00100000:0.0:1787602665.532093:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853698560 00000100:00100000:0.0:1787602665.532176:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787602665.532189:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+18:15825:x1874436853698560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602665.532212:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602665.532237:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d35354e3600/0x3640686da09dc47f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc478 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602665.532271:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35354e3600/0x3640686da09dc47f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc478 expref: 19 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602665.532286:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d35354e3600/0x3640686da09dc47f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc478 expref: 19 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602665.532297:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e3600, rc 0) 00000100:00100000:0.0:1787602665.532400:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+19:15825:x1874436853698560:12345-0@lo:101:mount.lustre.0 Request processed in 212us (4356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602665.532408:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787602665.532495:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853698560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787602665.532531:0:15825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d353d432600/0x3640686da09dc478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc47f expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602665.532543:0:15825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d353d432600/0x3640686da09dc478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc47f expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787602665.533322:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787602665.533686:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787602665.534012:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787602665.534056:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787602665.534088:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787602665.534133:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787602665.534169:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787602665.534231:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787602665.534265:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787602665.534296:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787602665.534341:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787602665.534372:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787602665.534402:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787602665.534446:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787602665.534481:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787602665.534513:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787602665.534559:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787602665.534610:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787602665.534644:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787602665.534690:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787602665.534723:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787602665.534788:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787602665.534838:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787602665.534892:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787602665.534924:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787602665.534969:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787602665.535014:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787602665.535045:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787602665.535090:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787602665.535122:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787602665.535153:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787602665.535210:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1787602665.535246:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1787602665.535279:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1787602665.535311:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1787602665.535357:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1787602665.535392:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1787602665.535438:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1787602665.535471:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1787602665.552698:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1787602665.552734:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787602665.552907:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405080a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853698688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602665.553002:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602665.553071:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853698688 00000100:00100000:0.0:1787602665.553081:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853698688 00000100:00100000:0.0:1787602665.553135:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787602665.553146:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+19:15825:x1874436853698688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602665.553475:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+19:15825:x1874436853698688:12345-0@lo:501:mount.lustre.0 Request processed in 329us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602665.553485:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787602665.553542:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602665.553569:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405080a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853698688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787602665.553621:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405080a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853698816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787602665.553667:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602665.553705:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853698816 00000100:00100000:0.0:1787602665.553710:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853698816 00000100:00100000:0.0:1787602665.553736:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787602665.553772:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+19:15825:x1874436853698816:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787602665.554070:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+19:15825:x1874436853698816:12345-0@lo:503:mount.lustre.0 Request processed in 326us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602665.554077:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787602665.554116:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602665.554128:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405080a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853698816:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787602665.554900:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787602665.554996:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405080a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853698944:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602665.555056:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602665.555109:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853698944 00000100:00100000:0.0:1787602665.555116:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853698944 00000100:00100000:0.0:1787602665.555152:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787602665.555161:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+19:15825:x1874436853698944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602665.555436:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+19:15825:x1874436853698944:12345-0@lo:502:mount.lustre.0 Request processed in 274us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602665.555445:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787602665.555493:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602665.555510:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405080a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853698944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787602665.566061:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787602665.566189:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787602665.566224:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787602665.566274:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787602665.566312:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787602665.566373:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787602665.566417:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787602665.566448:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787602665.566492:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787602665.566528:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787602665.566562:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787602665.566633:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787602665.566688:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787602665.566725:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787602665.566813:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787602665.566849:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787602665.566878:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787602665.566926:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787602665.566960:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787602665.566990:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787602665.567035:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787602665.567069:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787602665.567099:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787602665.567143:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787602665.567176:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787602665.567208:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787602665.567266:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787602665.567305:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787602665.567354:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787602665.567405:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787602665.567442:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787602665.567476:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787602665.567510:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787602665.567561:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787602665.567614:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787602665.567664:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787602665.567695:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787602665.567727:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787602665.567809:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787602665.567861:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787602665.567933:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405080a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853699072:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602665.568048:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602665.568128:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853699072 00000100:00100000:0.0:1787602665.568137:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853699072 00000100:00100000:0.0:1787602665.568207:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787602665.568219:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+19:15825:x1874436853699072:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787602665.568507:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+19:15825:x1874436853699072:12345-0@lo:502:mount.lustre.0 Request processed in 289us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602665.568516:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787602665.581119:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602665.581178:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405080a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853699072:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787602665.581394:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787602665.581415:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787602665.603328:0:15835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787602665.603377:0:15835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d3405420000) 00000020:00000080:0.0:1787602665.603410:0:15835:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1787602665.603514:0:15835:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d3505485000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787602665.603519:0:15835:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d3505485000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787602665.603522:0:15835:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d3505485000 3 00010000:00080000:0.0:1787602665.603561:0:15835:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d350c252800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.126@tcp at head 00010000:00010000:0.0:1787602665.605517:0:15835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1787602665.622520:0:15835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787602665.623371:0:15835:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787602665.623393:0:15835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3640686da09dc48d 00000100:00080000:0.0:1787602665.623409:0:15835:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787602665.623417:0:15835:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d350c252800 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:0.0:1787602665.623468:0:15835:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3405080a80 x1874436853699200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787602665.623521:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1874436853699200:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787602665.623630:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787602665.623713:0:15835:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787602665.623791:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787602665.623796:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787602665.623798:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d3527a94000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787602665.623803:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:0.0:1787602665.623807:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787602665.623812:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d3527a94000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:0.0:1787602665.623827:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3405081c00 x1874436853699456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787602665.623876:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853699456:0@lo:8:kworker.0 00000100:00100000:0.0:1787602665.623906:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602665.623944:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853699456 00000100:00100000:0.0:1787602665.623952:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853699456 00000100:00100000:0.0:1787602665.623988:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787602665.623997:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1874436853699456:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787602665.624059:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1874436853699456:12345-0@lo:8:kworker.0 Request processed in 62us (152us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787602665.624066:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787602665.624105:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787602665.624113:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d3527a94000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787602665.624117:0:3300:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787602665.624121:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853699456:0@lo:8:kworker.0 00000100:00100000:2.0:1787602665.625197:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853699712:0@lo:400:kworker.0 00000100:00100000:2.0:1787602665.625311:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602665.625346:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787602665.625354:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853699584:0@lo:400:kworker.0 00000100:00100000:2.0:1787602665.625381:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602665.625413:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602665.625423:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853699328:0@lo:400:kworker.0 00000100:00100000:2.0:1787602665.625452:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602665.625498:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853699328 00000100:00100000:2.0:1787602665.625506:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853699328 00000100:00100000:2.0:1787602665.625568:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602665.625589:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853699328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602665.625650:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853699328:12345-0@lo:400:kworker.0 Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602665.625658:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787602665.625699:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853699328:0@lo:400:kworker.0 00000040:00080000:2.0:1787602665.626419:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1787602665.627713:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853699200 00000100:00100000:1.0:1787602665.627729:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853699200 00000100:00100000:1.0:1787602665.627788:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853699712 00000100:00100000:1.0:1787602665.627793:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853699712 00000100:00100000:1.0:1787602665.627825:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853699584 00000100:00100000:1.0:1787602665.627829:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853699584 00000100:00100000:1.0:1787602665.627849:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787602665.627859:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853699712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602665.627979:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874436853699712:12345-0@lo:400:kworker.0 Request processed in 121us (2668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602665.627988:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787602665.628006:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787602665.628012:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853699584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602665.628042:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874436853699584:12345-0@lo:400:kworker.0 Request processed in 31us (2660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602665.628048:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787602665.628059:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602665.628075:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3300:x1874436853699200:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787602665.628103:0:14422:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:1.0:1787602665.628152:0:14422:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3640686da09dc494 00000004:00100000:1.0:1787602665.628173:0:14422:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787602665.628213:0:14422:0:(import.c:65:import_set_state_nolock()) ffff8d3534658000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602665.628260:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874436853699200:12345-0@lo:38:llog_process_th.0 Request processed in 183us (4630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602665.628267:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787602665.628296:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787602665.628302:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787602665.629524:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3405081880 x1874436853699584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602665.629545:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874436853699584:0@lo:400:kworker.0 00010000:00080000:1.0:1787602665.629563:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3405083b80 x1874436853699712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602665.629572:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1874436853699712:0@lo:400:kworker.0 00010000:00080000:1.0:1787602665.629651:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d3405080a80 x1874436853699200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787602675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602665.629660:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787602665.629668:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787602665.629679:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787602665.629685:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787602665.629687:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d350c252800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787602665.629694:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405080a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1874436853699200:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1787602665.630850:0:15825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787602665.630900:0:15825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787602665.630925:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d353d432600/0x3640686da09dc478 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc47f expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602665.630939:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d353d432600/0x3640686da09dc478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc47f expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787602665.631007:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787602665.631010:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787602665.631012:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787602665.631013:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787602665.631014:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787602665.631016:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787602665.631017:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787602665.631020:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787602665.631022:0:15825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787602665.631026:0:15825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787602665.631029:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787602665.631031:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787602665.631032:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787602665.631033:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787602665.631034:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787602665.631035:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787602665.631036:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787602665.631037:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787602665.631038:0:15825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787602665.631073:0:15825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787602665.631099:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853699840:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787602665.631186:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602665.631232:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350343f000 going to sleep for 11 seconds 00000100:00100000:0.0:1787602665.631274:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853699840 00000100:00100000:0.0:1787602665.631281:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853699840 00000100:00100000:0.0:1787602665.631331:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787602665.631349:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353510c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+19:15825:x1874436853699840:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787602665.631384:0:14414:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787602665.631403:0:14414:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787602665.775353:0:14414:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787602665.775377:0:14414:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787602665.775458:0:14437:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787602665.775465:0:14437:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787602665.775495:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d353d432000/0x3640686da09dc49b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602665.775518:0:14437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d35354eb000/0x3640686da09dc375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc36e expref: 19 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602665.775528:0:14437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d353d432000/0x3640686da09dc49b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602665.775592:0:14437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d35354eb000/0x3640686da09dc375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09dc36e expref: 19 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602665.775610:0:14437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d35354eb000/0x3640686da09dc375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09dc36e expref: 19 pid: 14416 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602665.775628:0:14437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14437:1874436853699968:0@lo:104: 00000100:00100000:3.0:1787602665.775945:0:14437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602665.776038:0:14437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35034323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602665.776103:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853699968 00000100:00100000:1.0:1787602665.776112:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853699968 00000100:00100000:1.0:1787602665.776179:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602665.776190:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:704a385b-7757-43d8-8441-546b4c8b60c7+3:14437:x1874436853699968:12345-0@lo:104: 00010000:00010000:1.0:1787602665.776206:0:14405:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc36e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dc375 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.776274:0:14405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787602665.776281:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:704a385b-7757-43d8-8441-546b4c8b60c7+3:14437:x1874436853699968:12345-0@lo:104: Request processed in 92us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602665.776289:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602665.776332:0:14437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14437:1874436853699968:0@lo:104: 00010000:00010000:1.0:1787602665.776361:0:14437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d353d432000/0x3640686da09dc49b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602665.776573:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602665.776593:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc36e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dc375 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602665.776603:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e2800 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:0.0:1787602665.776608:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc36e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09dc375 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602665.776619:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc36e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09dc375 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787602665.776628:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc36e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09dc375 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602665.776635:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787602665.776687:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc36e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc375 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602665.776696:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787602665.776728:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc36e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc375 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602665.776737:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc36e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc375 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602665.776782:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602665.776784:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602665.776795:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602665.776804:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787602665.776820:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:704a385b-7757-43d8-8441-546b4c8b60c7:3304:1874436853700096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787602665.776862:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602665.777179:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853700096 00000100:00100000:1.0:1787602665.777185:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853700096 00010000:00010000:1.0:1787602665.777210:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d35354eb000/0x3640686da09dc375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dc36e expref: 20 pid: 14416 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602665.777245:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602665.777254:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405083100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704a385b-7757-43d8-8441-546b4c8b60c7+20:3304:x1874436853700096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787602665.777267:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602665.777273:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d35354eb000/0x3640686da09dc375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dc36e expref: 20 pid: 14416 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.777287:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d35354eb000/0x3640686da09dc375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09dc36e expref: 20 pid: 14416 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.777310:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d35354eb000/0x3640686da09dc375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09dc36e expref: 20 pid: 14416 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.777328:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d353d432000/0x3640686da09dc49b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.777337:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d432000/0x3640686da09dc49b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787602665.777354:0:14407:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003793129s 00010000:00010000:1.0:1787602665.777359:0:14407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d353d432000/0x3640686da09dc49b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.777368:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d353d432000/0x3640686da09dc49b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.777375:0:14407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d353d432000/0x3640686da09dc49b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.777383:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d353d432000/0x3640686da09dc49b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.777389:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432000 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602665.777394:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d353d432000/0x3640686da09dc49b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.777403:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d353d432000/0x3640686da09dc49b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.777424:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d353d432000/0x3640686da09dc49b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602665.777441:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602665.777480:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405083100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704a385b-7757-43d8-8441-546b4c8b60c7+19:3304:x1874436853700096:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602665.777488:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787602665.777521:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405080000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:704a385b-7757-43d8-8441-546b4c8b60c7:3304:1874436853700096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787602665.777600:0:14437:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d353d432000/0x3640686da09dc49b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602665.777610:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d353d432000/0x3640686da09dc49b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602665.777617:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d353d432000/0x3640686da09dc49b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602665.784450:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353510c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+18:15825:x1874436853699840:12345-0@lo:253:mount.lustre.0 Request processed in 153084us (153245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602665.784470:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787602665.784637:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:704a385b-7757-43d8-8441-546b4c8b60c7:15825:1874436853699840:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787602665.784674:0:15825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787602665.784680:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787602665.784682:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787602665.784684:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787602665.784685:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787602665.784687:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787602665.784689:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787602665.784691:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787602665.784693:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787602665.784695:0:15825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787602665.784899:0:15825:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787602665.803952:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787602665.804391:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787602665.805013:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787602665.805179:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787602665.805446:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787602665.810071:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787602665.818285:0:15825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787602665.856865:0:15825:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787602665.856880:0:15825:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787602665.856936:0:15825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787602665.857015:0:15825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.126@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787602665.857035:0:15825:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787602665.857078:0:15825:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787602666.351864:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787602666.863354:0:14419:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787602666.863362:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d353cc8e000 from 8 10000000:01000000:0.0:1787602666.863367:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787602666.863414:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e2400/0x3640686da09dc4a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602666.863426:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35354e2400/0x3640686da09dc4a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602666.863439:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35354e2400/0x3640686da09dc4a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602666.863467:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853700224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602666.863669:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602666.863896:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35033f9480 going to sleep for 11 seconds 00000100:00100000:1.0:1787602666.874266:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853700224 00000100:00100000:1.0:1787602666.874288:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853700224 00000100:00100000:1.0:1787602666.874390:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787602666.874403:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353510fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+18:14419:x1874436853700224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602666.874426:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602666.874452:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d35354ea200/0x3640686da09dc4a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc4a2 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602666.874495:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35354ea200/0x3640686da09dc4a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc4a2 expref: 19 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602666.874509:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d35354ea200/0x3640686da09dc4a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc4a2 expref: 19 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602666.874520:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354ea200, rc 0) 00000100:00100000:1.0:1787602666.874641:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353510fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+19:14419:x1874436853700224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 241us (10972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602666.874665:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787602666.875308:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853700224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602666.875331:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35354e2400/0x3640686da09dc4a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc4a9 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602666.875342:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35354e2400/0x3640686da09dc4a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc4a9 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602666.875411:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405081c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853700352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787602666.875455:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602666.875534:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35033f9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787602666.878624:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853700352 00000100:00100000:2.0:1787602666.878639:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853700352 00000100:00100000:1.0:1787602666.878864:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787602666.878875:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353510f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+19:14419:x1874436853700352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787602666.878903:0:14414:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787602666.878921:0:14414:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787602666.878924:0:14414:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787602666.879060:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353510f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+19:14419:x1874436853700352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 186us (3604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602666.879069:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787602666.879174:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405081c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853700352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787602666.879247:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787602666.879258:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e2400/0x3640686da09dc4a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc4a9 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602666.879269:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35354e2400/0x3640686da09dc4a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc4a9 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602667.122834:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602667.122859:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853700480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602667.122926:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602667.122986:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853700480 00000100:00100000:2.0:1787602667.122992:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853700480 00000100:00100000:2.0:1787602667.123042:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787602667.123051:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853700480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602667.123086:0:15107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602667.123128:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853700480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602667.123135:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787602667.123154:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602667.123186:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853700480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787602667.376056:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602668.397191:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602669.422019:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602670.446625:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602670.703179:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:704a385b-7757-43d8-8441-546b4c8b60c7:3301:1874436853700608:0@lo:400:kworker.0 00000100:00100000:0.0:1787602670.703258:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602670.703505:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853700608 00000100:00100000:1.0:1787602670.703513:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853700608 00000100:00100000:1.0:1787602670.703562:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787602670.703571:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353510e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+19:3301:x1874436853700608:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787602670.703649:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787602670.703654:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787602670.703658:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d3527a94000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787602670.703666:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d3527a94000 using connection 192.168.201.126@tcp/0@lo 00000100:00100000:3.0:1787602670.703691:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d3534f7d880 x1874436853700864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787602670.703780:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853700736:0@lo:400:kworker.0 00000100:00100000:3.0:1787602670.703843:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602670.703870:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787602670.703875:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853701248:0@lo:400:kworker.0 00000100:00100000:3.0:1787602670.703904:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602670.703932:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853700992:0@lo:400:kworker.0 00000100:00100000:3.0:1787602670.703954:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602670.703973:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787602670.703979:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853701120:0@lo:400:kworker.0 00000100:00100000:3.0:1787602670.704002:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602670.704050:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853700736 00000100:00100000:3.0:1787602670.704055:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853700736 00000100:00100000:3.0:1787602670.704099:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602670.704109:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853700736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602670.704146:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853700736:12345-0@lo:400:kworker.0 Request processed in 41us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602670.704153:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787602670.704175:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853701248 00000100:00100000:3.0:1787602670.704179:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853701248 00000100:00100000:3.0:1787602670.704204:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853700992 00000100:00100000:3.0:1787602670.704207:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853700992 00000100:00100000:3.0:1787602670.704218:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853701120 00000100:00100000:3.0:1787602670.704220:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853701120 00000100:00100000:3.0:1787602670.704234:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787602670.704240:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853701248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602670.704271:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853701248:12345-0@lo:400:kworker.0 Request processed in 30us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602670.704277:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787602670.704298:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787602670.704304:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853700992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602670.704336:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853700992:12345-0@lo:400:kworker.0 Request processed in 32us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602670.704341:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787602670.704352:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787602670.704358:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853701120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602670.704382:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853701120:12345-0@lo:400:kworker.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602670.704388:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787602670.704410:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787602670.704414:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787602670.704439:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f7ed80 x1874436853701120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602670.704451:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853701120:0@lo:400:kworker.0 00010000:00080000:3.0:1787602670.704461:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f7d500 x1874436853700992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602670.704469:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853700992:0@lo:400:kworker.0 00010000:00080000:3.0:1787602670.704506:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f7e300 x1874436853701248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602670.704513:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853701248:0@lo:400:kworker.0 00000100:00100000:3.0:1787602670.704523:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853700736:0@lo:400:kworker.0 00000100:00100000:3.0:1787602670.709781:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853700864:0@lo:8:kworker.0 00000100:00100000:3.0:1787602670.709934:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602670.710000:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853700864 00000100:00100000:3.0:1787602670.710007:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853700864 00000100:00100000:3.0:1787602670.710037:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787602670.710043:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1874436853700864:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787602670.710072:0:15103:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:3.0:1787602670.710101:0:15103:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3640686da09dc4b0 00002000:00100000:3.0:1787602670.710113:0:15103:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d3534d8a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113951 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787602670.710118:0:15103:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787602670.710121:0:15103:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787602670.710448:0:15103:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787602670.710472:0:15103:0:(import.c:65:import_set_state_nolock()) ffff8d3534d8f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787602670.710534:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1874436853700864:12345-0@lo:8:kworker.0 Request processed in 489us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602670.710541:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787602670.710582:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f7d880 x1874436853700864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787602695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787602670.710598:0:3300:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787602670.710606:0:3300:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787602670.710611:0:3300:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787602670.710613:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d3527a94000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787602670.710634:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787602670.710640:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1874436853700864:0@lo:8:kworker.0 00000004:00080000:3.0:1787602670.710688:0:14446:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1787602670.710705:0:14446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14446:1874436853701504:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787602670.710740:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602670.710995:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353510e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+19:3301:x1874436853700608:12345-0@lo:400:kworker.0 Request processed in 7423us (7736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602670.711005:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000004:00080000:1.0:1787602670.711027:0:14445:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787602670.711375:0:14445:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 455657631072ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787602670.713172:0:14446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3503432480 going to sleep for 11 seconds 00000100:00100000:3.0:1787602670.713198:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853701376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602670.713244:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602670.713285:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853701376 00000100:00100000:3.0:1787602670.713292:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853701376 00000100:00100000:3.0:1787602670.713343:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602670.713352:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874436853701376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787602670.713386:0:15107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602670.713425:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874436853701376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602670.713432:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787602670.713452:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787602670.713477:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f7d880 x1874436853701376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787602686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787602670.713711:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853701504 00000100:00100000:1.0:1787602670.713715:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853701504 00000100:00100000:1.0:1787602670.713768:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787602670.713775:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14446:x1874436853701504:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787602670.714660:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853701376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602670.719228:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:704a385b-7757-43d8-8441-546b4c8b60c7:3301:1874436853700608:0@lo:400:kworker.0 00002000:00080000:1.0:1787602670.728123:0:15106:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787602670.728134:0:15106:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787602670.728141:0:15106:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1787602670.742999:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.743018:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc4b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.743035:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.743040:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.743047:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc4b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.743063:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc4b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.743074:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc4b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.743082:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc4b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.743104:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602670.743371:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602670.743378:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc4b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.743387:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eac00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602670.743391:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc4b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.743401:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc4b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.743429:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc4b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.743437:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc4b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.743458:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602670.743460:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602670.743462:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787602670.745134:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.745145:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc4be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.745160:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.745165:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.745171:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc4be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.745183:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc4be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.745200:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc4be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.745207:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc4be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.745229:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787602670.745240:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602670.745246:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc4be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.745253:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eb000 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602670.745257:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc4be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.745265:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc4be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.745290:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc4be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.745298:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc4be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.745314:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602670.745339:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602670.745340:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787602670.745877:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.745883:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc4c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.745892:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.745896:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.745900:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc4c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.745909:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc4c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.745917:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc4c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.745924:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc4c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.745946:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787602670.746319:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.746325:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc4cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.746333:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.746336:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.746340:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc4cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.746357:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc4cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.746365:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc4cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.746372:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc4cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.746386:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787602670.746397:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787602670.746401:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc4c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.746408:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eb400 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602670.746412:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc4c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.746419:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc4c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.746431:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc4c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.746437:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc4c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.746459:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602670.746462:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc4cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.746469:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea600 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602670.746472:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc4cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.746480:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc4cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.746554:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602670.751661:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc4cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.751683:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc4cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.751709:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602670.751711:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602670.751713:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787602670.753845:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.753858:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb2544f5/0x3640686da09dc4d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.753876:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.753887:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.753893:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb2544f5/0x3640686da09dc4d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.753908:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb2544f5/0x3640686da09dc4d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.753919:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb2544f5/0x3640686da09dc4d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.753926:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb2544f5/0x3640686da09dc4d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.753952:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787602670.754235:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602670.754242:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb2544f5/0x3640686da09dc4d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.754251:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eaa00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602670.754256:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb2544f5/0x3640686da09dc4d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.754266:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb2544f5/0x3640686da09dc4d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.754286:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb2544f5/0x3640686da09dc4d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.754293:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb2544f5/0x3640686da09dc4d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.754325:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602670.754326:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602670.754328:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787602670.755883:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.755893:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c934d7a5/0x3640686da09dc4da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.755909:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.755913:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.755919:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c934d7a5/0x3640686da09dc4da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.755932:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c934d7a5/0x3640686da09dc4da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.755941:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c934d7a5/0x3640686da09dc4da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.755954:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c934d7a5/0x3640686da09dc4da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.755971:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787602670.755982:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602670.755988:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c934d7a5/0x3640686da09dc4da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.755995:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eb200 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602670.756000:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c934d7a5/0x3640686da09dc4da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.756008:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c934d7a5/0x3640686da09dc4da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.756023:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c934d7a5/0x3640686da09dc4da lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.756030:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c934d7a5/0x3640686da09dc4da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.756046:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602670.756048:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602670.756049:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787602670.756437:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.756449:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0032d5a/0x3640686da09dc4e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.756458:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.756461:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.756478:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0032d5a/0x3640686da09dc4e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.756487:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0032d5a/0x3640686da09dc4e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.756504:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0032d5a/0x3640686da09dc4e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.756512:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0032d5a/0x3640686da09dc4e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.756531:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787602670.756903:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.756908:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dc4e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.756916:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.756919:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.756923:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dc4e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.756932:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dc4e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.756946:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dc4e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.756953:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dc4e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.756968:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787602670.756977:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787602670.756981:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0032d5a/0x3640686da09dc4e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.756987:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea000 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602670.756990:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0032d5a/0x3640686da09dc4e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.756998:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0032d5a/0x3640686da09dc4e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.757011:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0032d5a/0x3640686da09dc4e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.757018:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0032d5a/0x3640686da09dc4e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.757032:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602670.757040:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dc4e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.757047:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eba00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602670.757051:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dc4e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.757058:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dc4e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.757068:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dc4e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.757074:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db902930/0x3640686da09dc4e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.757085:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602670.757087:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602670.757088:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787602670.757467:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.757473:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df2749c7/0x3640686da09dc4ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.757481:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.757484:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.757488:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df2749c7/0x3640686da09dc4ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.757918:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602670.760965:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df2749c7/0x3640686da09dc4ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.760979:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df2749c7/0x3640686da09dc4ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.760988:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df2749c7/0x3640686da09dc4ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.761033:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787602670.761050:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787602670.761056:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df2749c7/0x3640686da09dc4ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.761065:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ebe00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:1.0:1787602670.761070:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df2749c7/0x3640686da09dc4ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.761080:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df2749c7/0x3640686da09dc4ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.761098:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df2749c7/0x3640686da09dc4ef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.761106:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df2749c7/0x3640686da09dc4ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.761216:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602670.761218:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602670.761220:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787602670.761868:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.761876:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dc4f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.761889:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.761894:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.761901:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dc4f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.761911:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dc4f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.761919:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dc4f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.761927:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dc4f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.761949:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787602670.762662:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.762670:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dc4fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.762691:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.762695:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.762699:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dc4fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.762709:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dc4fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.762718:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dc4fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.762726:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dc4fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.762818:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787602670.763276:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.763282:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc504 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.763291:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.763294:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.763298:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc504 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.763307:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc504 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.763325:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc504 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.763333:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc504 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.763420:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787602670.763427:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dc4f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.763435:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eae00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:3.0:1787602670.763439:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dc4f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.763447:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dc4f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.763477:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dc4f6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.763483:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd1e0cf2/0x3640686da09dc4f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.763515:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787602670.763519:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dc4fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.763525:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ebc00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:3.0:1787602670.763528:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dc4fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.763535:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dc4fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.763545:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dc4fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.763551:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004de81032/0x3640686da09dc4fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.766093:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602670.766107:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.766131:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eac00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:3.0:1787602670.766151:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.766163:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc504 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.766185:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc504 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.766195:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602670.766197:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602670.766200:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602670.766481:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787602670.766499:0:15106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4cb3889/0x3640686da09dc504 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787602670.767258:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.767266:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc50b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.767279:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.767284:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.767291:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc50b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.767303:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc50b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.767313:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc50b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.767332:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc50b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.767342:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787602670.767716:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.767721:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc512 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.767729:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.767732:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.767736:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc512 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.767766:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc512 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.767773:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc512 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.767780:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc512 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.767788:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787602670.768141:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.768147:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc519 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.768159:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.768162:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.768166:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc519 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.768175:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc519 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.768183:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc519 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.768190:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc519 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.768197:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787602670.768584:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.768590:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1a06c4/0x3640686da09dc520 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.768599:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.768602:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.768606:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1a06c4/0x3640686da09dc520 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.768614:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc1a06c4/0x3640686da09dc520 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.768634:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1a06c4/0x3640686da09dc520 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.768642:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1a06c4/0x3640686da09dc520 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.768650:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787602670.769061:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.769067:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004882f0bf/0x3640686da09dc527 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.769076:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.769079:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.769083:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004882f0bf/0x3640686da09dc527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.769092:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004882f0bf/0x3640686da09dc527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.769101:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004882f0bf/0x3640686da09dc527 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.769108:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004882f0bf/0x3640686da09dc527 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.769128:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1787602670.770713:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787602670.770725:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc50b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770737:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354ea600 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602670.770760:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc50b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770771:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc50b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770791:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc50b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770798:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcdee634/0x3640686da09dc50b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770820:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787602670.770824:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc512 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770830:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eb400 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602670.770842:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc512 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770850:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc512 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770861:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc512 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770867:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e033b80/0x3640686da09dc512 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770880:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787602670.770884:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc519 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770890:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354eb000 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602670.770893:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc519 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770901:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc519 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770911:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc519 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770917:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042d01840/0x3640686da09dc519 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770935:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787602670.770938:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc1a06c4/0x3640686da09dc520 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770944:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406856c00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602670.770947:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1a06c4/0x3640686da09dc520 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770954:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1a06c4/0x3640686da09dc520 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770962:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc1a06c4/0x3640686da09dc520 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770969:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc1a06c4/0x3640686da09dc520 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770981:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787602670.770985:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004882f0bf/0x3640686da09dc527 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.770990:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406856800 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602670.770993:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004882f0bf/0x3640686da09dc527 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.771010:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004882f0bf/0x3640686da09dc527 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.771020:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004882f0bf/0x3640686da09dc527 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.771026:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004882f0bf/0x3640686da09dc527 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602670.771037:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602670.771039:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602670.771041:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602670.776955:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787602670.778462:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.778478:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000620f0a82/0x3640686da09dc52e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.778509:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.778514:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.778522:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000620f0a82/0x3640686da09dc52e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.778538:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000620f0a82/0x3640686da09dc52e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.778549:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000620f0a82/0x3640686da09dc52e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.778567:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000620f0a82/0x3640686da09dc52e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.778588:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787602670.779341:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.779349:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6537ce0/0x3640686da09dc535 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.779358:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.779367:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.779372:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6537ce0/0x3640686da09dc535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.779383:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6537ce0/0x3640686da09dc535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.779392:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6537ce0/0x3640686da09dc535 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.779399:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6537ce0/0x3640686da09dc535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.779419:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787602670.779675:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787602670.779684:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000620f0a82/0x3640686da09dc52e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.779692:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406857a00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602670.779697:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000620f0a82/0x3640686da09dc52e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.779706:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000620f0a82/0x3640686da09dc52e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.779728:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000620f0a82/0x3640686da09dc52e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.779765:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000620f0a82/0x3640686da09dc52e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.779787:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602670.779791:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6537ce0/0x3640686da09dc535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.779797:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406856e00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602670.779800:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6537ce0/0x3640686da09dc535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.779809:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6537ce0/0x3640686da09dc535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.779818:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6537ce0/0x3640686da09dc535 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.779825:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6537ce0/0x3640686da09dc535 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.779837:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602670.779839:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602670.779841:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787602670.780511:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.780519:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000175dff9e/0x3640686da09dc53c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.780529:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.780533:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.780537:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000175dff9e/0x3640686da09dc53c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.780549:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000175dff9e/0x3640686da09dc53c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.780558:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000175dff9e/0x3640686da09dc53c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.780643:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000175dff9e/0x3640686da09dc53c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.780707:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787602670.781183:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.781189:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000723bcd92/0x3640686da09dc543 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.781199:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.781202:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.781207:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000723bcd92/0x3640686da09dc543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.781216:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000723bcd92/0x3640686da09dc543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.781224:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000723bcd92/0x3640686da09dc543 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.781231:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000723bcd92/0x3640686da09dc543 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.785414:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787602670.785430:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000175dff9e/0x3640686da09dc53c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.785455:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406856a00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602670.785461:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000175dff9e/0x3640686da09dc53c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.785472:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000175dff9e/0x3640686da09dc53c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.785502:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000175dff9e/0x3640686da09dc53c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.785511:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000175dff9e/0x3640686da09dc53c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.785535:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602670.785539:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000723bcd92/0x3640686da09dc543 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.785545:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406857c00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602670.785549:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000723bcd92/0x3640686da09dc543 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.785623:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000723bcd92/0x3640686da09dc543 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.785638:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000723bcd92/0x3640686da09dc543 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.785653:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602670.785654:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602670.785657:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602670.787863:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787602670.787878:0:15106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000723bcd92/0x3640686da09dc543 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787602670.788612:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.788621:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060b712b4/0x3640686da09dc54a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.788637:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.788642:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.788649:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060b712b4/0x3640686da09dc54a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.788664:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060b712b4/0x3640686da09dc54a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.788675:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060b712b4/0x3640686da09dc54a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.788681:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060b712b4/0x3640686da09dc54a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.788692:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787602670.789125:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.789132:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3fc81fd/0x3640686da09dc551 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.789141:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.789145:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.789155:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3fc81fd/0x3640686da09dc551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.789165:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3fc81fd/0x3640686da09dc551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.789173:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3fc81fd/0x3640686da09dc551 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.789180:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3fc81fd/0x3640686da09dc551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.789189:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787602670.789589:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.789596:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec5aba90/0x3640686da09dc558 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.789606:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.789609:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.789614:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec5aba90/0x3640686da09dc558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.789624:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec5aba90/0x3640686da09dc558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.789633:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec5aba90/0x3640686da09dc558 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.789652:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec5aba90/0x3640686da09dc558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.789661:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787602670.790083:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.790089:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000036aa054/0x3640686da09dc55f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.790097:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.790101:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.790105:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000036aa054/0x3640686da09dc55f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.790114:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000036aa054/0x3640686da09dc55f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.790122:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000036aa054/0x3640686da09dc55f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.790130:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000036aa054/0x3640686da09dc55f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.790138:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787602670.790556:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.790562:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000392bd7eb/0x3640686da09dc566 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.790577:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.790580:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.790584:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000392bd7eb/0x3640686da09dc566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.790594:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000392bd7eb/0x3640686da09dc566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.790602:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000392bd7eb/0x3640686da09dc566 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.790610:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000392bd7eb/0x3640686da09dc566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.790619:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787602670.791035:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.791041:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebe8f316/0x3640686da09dc56d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.791050:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.791053:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.791057:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebe8f316/0x3640686da09dc56d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.791066:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebe8f316/0x3640686da09dc56d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.791085:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebe8f316/0x3640686da09dc56d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.791093:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebe8f316/0x3640686da09dc56d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.791102:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1787602670.792868:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787602670.792883:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060b712b4/0x3640686da09dc54a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.792898:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406856400 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602670.792903:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060b712b4/0x3640686da09dc54a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.792914:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060b712b4/0x3640686da09dc54a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.792935:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060b712b4/0x3640686da09dc54a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.792943:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060b712b4/0x3640686da09dc54a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.792970:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787602670.792974:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3fc81fd/0x3640686da09dc551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.792981:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406856000 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602670.792995:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3fc81fd/0x3640686da09dc551 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793004:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3fc81fd/0x3640686da09dc551 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793015:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3fc81fd/0x3640686da09dc551 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793022:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3fc81fd/0x3640686da09dc551 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793037:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787602670.793041:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec5aba90/0x3640686da09dc558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793059:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406857800 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602670.793064:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec5aba90/0x3640686da09dc558 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793072:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec5aba90/0x3640686da09dc558 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793083:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec5aba90/0x3640686da09dc558 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793090:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec5aba90/0x3640686da09dc558 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793111:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787602670.793115:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000036aa054/0x3640686da09dc55f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793121:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406857600 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602670.793124:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000036aa054/0x3640686da09dc55f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793132:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000036aa054/0x3640686da09dc55f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793143:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000036aa054/0x3640686da09dc55f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793150:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000036aa054/0x3640686da09dc55f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793162:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787602670.793166:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000392bd7eb/0x3640686da09dc566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793172:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406857e00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602670.793176:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000392bd7eb/0x3640686da09dc566 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793195:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000392bd7eb/0x3640686da09dc566 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793205:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000392bd7eb/0x3640686da09dc566 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793212:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000392bd7eb/0x3640686da09dc566 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793227:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787602670.793231:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebe8f316/0x3640686da09dc56d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793238:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406857000 already unused, calling callback (ffffffffc1656230) 00010000:00010000:0.0:1787602670.793241:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebe8f316/0x3640686da09dc56d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793248:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebe8f316/0x3640686da09dc56d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793258:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebe8f316/0x3640686da09dc56d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793265:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebe8f316/0x3640686da09dc56d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602670.793289:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602670.793291:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602670.793293:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602670.800408:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787602670.804436:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787602670.804451:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5360148/0x3640686da09dc574 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.804469:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787602670.804474:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787602670.804481:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5360148/0x3640686da09dc574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.804507:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5360148/0x3640686da09dc574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.804518:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5360148/0x3640686da09dc574 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.804527:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5360148/0x3640686da09dc574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602670.804558:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787602670.804667:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602670.804675:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5360148/0x3640686da09dc574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.804684:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406857200 already unused, calling callback (ffffffffc1656230) 00010000:00010000:3.0:1787602670.804689:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5360148/0x3640686da09dc574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.804699:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5360148/0x3640686da09dc574 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.804727:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5360148/0x3640686da09dc574 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.804734:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5360148/0x3640686da09dc574 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602670.804781:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602670.804783:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602670.804785:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787602670.805295:0:15106:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1787602670.805724:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14446:x1874436853701504:12345-0@lo:5:osp-pre-1-0.0 Request processed in 91875us (94910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602670.805736:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787602670.811140:0:14446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14446:1874436853701504:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787602670.811163:0:14446:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1787602670.811217:0:14446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14446:1874436853701632:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787602670.811277:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602670.811340:0:14446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350cbcf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787602670.811447:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853701632 00000100:00100000:0.0:1787602670.811455:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853701632 00000100:00100000:0.0:1787602670.811519:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787602670.811529:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14446:x1874436853701632:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787602670.811587:0:15105:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1787602670.816938:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14446:x1874436853701632:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5401us (5651us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787602670.816952:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787602670.817127:0:14446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14446:1874436853701632:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787602670.817144:0:14446:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:2.0:1787602670.829695:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00080000:2.0:1787602671.322137:0:7646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1787602671.322203:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787602671.468935:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602672.238657:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853701760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602672.238737:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602672.238842:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853701760 00000100:00100000:2.0:1787602672.238850:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853701760 00000100:00100000:2.0:1787602672.238908:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602672.238918:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853701760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602672.238952:0:15107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602672.238995:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853701760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602672.239002:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787602672.239035:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602672.239072:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853701760:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787602672.494836:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602673.527132:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787602673.720134:0:16179:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg126-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1787602674.234906:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787602674.540914:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787602675.565200:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602675.821703:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:704a385b-7757-43d8-8441-546b4c8b60c7:3304:1874436853701888:0@lo:400:kworker.0 00000100:00100000:3.0:1787602675.821778:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853702144:0@lo:400:kworker.0 00000100:00100000:2.0:1787602675.821818:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602675.821870:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853702400:0@lo:400:kworker.0 00000100:00100000:3.0:1787602675.821896:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602675.821908:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602675.821929:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787602675.821936:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602675.821941:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853702016:0@lo:400:kworker.0 00000100:00100000:2.0:1787602675.821946:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874436853702272:0@lo:400:kworker.0 00000100:00100000:3.0:1787602675.821979:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602675.821984:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602675.822012:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853702528:0@lo:400:kworker.0 00000100:00100000:2.0:1787602675.822029:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853701888 00000100:00100000:2.0:1787602675.822038:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853701888 00000100:00100000:3.0:1787602675.822043:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602675.822085:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787602675.822095:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853702144 00000100:00100000:2.0:1787602675.822096:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353510ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+19:3304:x1874436853701888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602675.822102:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853702144 00000100:00100000:2.0:1787602675.822152:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353510ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+19:3304:x1874436853701888:12345-0@lo:400:kworker.0 Request processed in 57us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602675.822156:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853702016 00000100:00100000:2.0:1787602675.822161:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787602675.822162:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853702016 00000100:00100000:3.0:1787602675.822187:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787602675.822196:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853702144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602675.822204:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853702400 00000100:00100000:2.0:1787602675.822209:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853702400 00000100:00100000:2.0:1787602675.822242:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853702272 00000100:00100000:3.0:1787602675.822245:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853702144:12345-0@lo:400:kworker.0 Request processed in 49us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602675.822246:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853702272 00000100:00100000:3.0:1787602675.822255:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787602675.822260:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853702528 00000100:00100000:2.0:1787602675.822264:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853702528 00000100:00100000:3.0:1787602675.822276:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602675.822285:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787602675.822287:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853702016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602675.822297:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853702400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602675.822322:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853702016:12345-0@lo:400:kworker.0 Request processed in 39us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602675.822330:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602675.822341:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874436853702400:12345-0@lo:400:kworker.0 Request processed in 46us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602675.822350:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787602675.822604:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787602675.822615:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874436853702272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602675.822697:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787602675.822705:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853702528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602675.822737:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853702528:12345-0@lo:400:kworker.0 Request processed in 33us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602675.822780:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787602675.822930:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874436853702272:12345-0@lo:400:kworker.0 Request processed in 317us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602675.822937:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787602675.822959:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853702656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602675.822987:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602675.823025:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853702016:0@lo:400:kworker.0 00010000:00080000:3.0:1787602675.823039:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d353d265180 x1874436853702528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787602675.823080:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853702528:0@lo:400:kworker.0 00000100:00080000:2.0:1787602675.823092:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787602675.823098:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787602675.823101:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787602675.823119:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853702656 00000100:00100000:2.0:1787602675.823124:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853702656 00000100:00100000:2.0:1787602675.823159:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787602675.823165:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787602675.823169:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853702656:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787602675.823184:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853702144:0@lo:400:kworker.0 00002000:00000024:2.0:1787602675.823198:0:15107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602675.823241:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853702656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602675.823247:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787602675.823276:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f7f100 x1874436853702272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602675.823285:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874436853702272:0@lo:400:kworker.0 00010000:00080000:2.0:1787602675.823296:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d3534f7df80 x1874436853702400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787602691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787602675.823304:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1874436853702400:0@lo:400:kworker.0 00000100:00100000:2.0:1787602675.823314:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:704a385b-7757-43d8-8441-546b4c8b60c7:3304:1874436853701888:0@lo:400:kworker.0 00000100:00100000:3.0:1787602675.823347:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853702656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602676.250202:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602676.255327:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833780736 00000100:00100000:1.0:1787602676.255344:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833780736 00000100:00100000:1.0:1787602676.255417:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 78 00000100:00100000:1.0:1787602676.255435:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353510e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1874436833780736:12345-192.168.201.26@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787602676.255470:0:14415:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 94d220dc-ff0a-4980-bb6f-25cb6d7fc683@192.168.201.26@tcp t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:1.0:1787602676.255503:0:14415:0:(genops.c:1385:class_connect()) connect: client 94d220dc-ff0a-4980-bb6f-25cb6d7fc683, cookie 0x3640686da09dc57b 00000100:00080000:1.0:1787602676.255667:0:14415:0:(import.c:65:import_set_state_nolock()) ffff8d350c25d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602676.255780:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353510e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+5:2350:x1874436833780736:12345-192.168.201.26@tcp:250:mount.lustre.0 Request processed in 344us (5586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602676.255788:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 78 00000100:00100000:3.0:1787602676.258434:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602676.258708:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833780864 00000100:00100000:0.0:1787602676.258719:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833780864 00000100:00100000:0.0:1787602676.258841:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 79 00000100:00100000:0.0:1787602676.258852:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+5:13749:x1874436833780864:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787602676.258870:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602676.258889:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d35354e3a00/0x3640686da09dc582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2745 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602676.258916:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35354e3a00/0x3640686da09dc582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2745 expref: 6 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602676.258926:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d35354e3a00/0x3640686da09dc582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2745 expref: 6 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602676.258950:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e3a00, rc 0) 00000100:00100000:0.0:1787602676.263880:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+6:13749:x1874436833780864:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 5015us (5444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602676.263894:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 79 00000100:00100000:2.0:1787602676.309261:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602676.309499:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833780992 00000100:00100000:1.0:1787602676.309510:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833780992 00000100:00100000:1.0:1787602676.309922:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 80 00000100:00100000:1.0:1787602676.309935:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+6:13749:x1874436833780992:12345-192.168.201.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787602676.310246:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+6:13749:x1874436833780992:12345-192.168.201.26@tcp:501:mount.lustre.0 Request processed in 314us (995us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787602676.310265:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 80 00000100:00100000:2.0:1787602676.321227:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602676.321353:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833781120 00000100:00100000:0.0:1787602676.321364:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833781120 00000100:00100000:0.0:1787602676.321430:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 81 00000100:00100000:0.0:1787602676.321441:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+6:13749:x1874436833781120:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787602676.321460:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602676.321496:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d35354e3400/0x3640686da09dc589 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c274c expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602676.321535:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35354e3400/0x3640686da09dc589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c274c expref: 7 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602676.321546:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d35354e3400/0x3640686da09dc589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c274c expref: 7 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602676.321564:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e3400, rc 0) 00000100:00100000:0.0:1787602676.321909:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+7:13749:x1874436833781120:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 467us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602676.321916:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 81 00000100:00100000:3.0:1787602676.326081:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602676.326178:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833781248 00000100:00100000:2.0:1787602676.326189:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833781248 00000100:00100000:2.0:1787602676.326250:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 82 00000100:00100000:2.0:1787602676.326262:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+7:13749:x1874436833781248:12345-192.168.201.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787602676.327012:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+8:13749:x1874436833781248:12345-192.168.201.26@tcp:501:mount.lustre.0 Request processed in 748us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602676.327022:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 82 00000100:00100000:2.0:1787602676.328897:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602676.328981:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833781376 00000100:00100000:1.0:1787602676.328995:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833781376 00000100:00100000:1.0:1787602676.329064:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 83 00000100:00100000:1.0:1787602676.329076:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+8:13749:x1874436833781376:12345-192.168.201.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787602676.329388:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+8:13749:x1874436833781376:12345-192.168.201.26@tcp:503:mount.lustre.0 Request processed in 313us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602676.329405:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 83 00000100:00100000:3.0:1787602676.332198:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602676.332431:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833781504 00000100:00100000:0.0:1787602676.332444:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833781504 00000100:00100000:0.0:1787602676.332517:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 84 00000100:00100000:0.0:1787602676.332529:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+8:13768:x1874436833781504:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787602676.332938:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+8:13768:x1874436833781504:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 411us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602676.332947:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 84 00000100:00100000:1.0:1787602676.348904:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602676.349498:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833781632 00000100:00100000:3.0:1787602676.349511:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833781632 00000100:00100000:3.0:1787602676.349573:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 85 00000100:00100000:3.0:1787602676.349584:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+8:13768:x1874436833781632:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787602676.350100:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+8:13768:x1874436833781632:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 515us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602676.350633:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 85 00000100:00100000:2.0:1787602676.360646:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602676.360922:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833781760 00000100:00100000:0.0:1787602676.360933:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833781760 00000100:00100000:0.0:1787602676.360994:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 86 00000100:00100000:0.0:1787602676.361008:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+8:13749:x1874436833781760:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787602676.361025:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602676.361044:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d35354e2000/0x3640686da09dc590 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2776 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602676.361074:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35354e2000/0x3640686da09dc590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2776 expref: 9 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602676.361085:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d35354e2000/0x3640686da09dc590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2776 expref: 9 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602676.361095:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e2000, rc 0) 00000100:00100000:0.0:1787602676.361173:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+9:13749:x1874436833781760:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 169us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602676.361181:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 86 00000100:00100000:1.0:1787602676.377533:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602676.377675:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833781888 00000100:00100000:3.0:1787602676.377687:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833781888 00000100:00100000:3.0:1787602676.377776:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 87 00000100:00100000:3.0:1787602676.377784:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+9:13749:x1874436833781888:12345-192.168.201.26@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787602676.377806:0:14416:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787602676.377826:0:14416:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787602676.377829:0:14416:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787602676.377831:0:14416:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787602676.377833:0:14416:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787602676.382564:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+9:13749:x1874436833781888:12345-192.168.201.26@tcp:256:mount.lustre.0 Request processed in 4771us (5032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602676.382576:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 87 00000100:00100000:2.0:1787602676.390413:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602676.390550:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833782016 00000100:00100000:1.0:1787602676.390563:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833782016 00000100:00100000:1.0:1787602676.390642:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 88 00000100:00100000:1.0:1787602676.390655:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+9:13749:x1874436833782016:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787602676.390679:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602676.390706:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3406857e00/0x3640686da09dc597 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c277d expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602676.390806:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3406857e00/0x3640686da09dc597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c277d expref: 10 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602676.390819:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3406857e00/0x3640686da09dc597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c277d expref: 10 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602676.390830:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3406857e00, rc 0) 00000100:00100000:1.0:1787602676.390913:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+10:13749:x1874436833782016:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 260us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602676.390944:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 88 00000100:00100000:1.0:1787602676.395070:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602676.395186:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833782144 00000100:00100000:2.0:1787602676.395201:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833782144 00000100:00100000:2.0:1787602676.395277:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 89 00000100:00100000:2.0:1787602676.395291:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+10:13749:x1874436833782144:12345-192.168.201.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787602676.395876:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+10:13749:x1874436833782144:12345-192.168.201.26@tcp:501:mount.lustre.0 Request processed in 587us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602676.395887:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 89 00000100:00100000:3.0:1787602676.402937:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602676.407937:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833782272 00000100:00100000:0.0:1787602676.407962:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833782272 00000100:00100000:0.0:1787602676.408079:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 90 00000100:00100000:0.0:1787602676.408097:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3508a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+10:13749:x1874436833782272:12345-192.168.201.26@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787602676.410514:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3508a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+10:13749:x1874436833782272:12345-192.168.201.26@tcp:503:mount.lustre.0 Request processed in 2405us (7575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602676.410548:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 90 00000100:00100000:3.0:1787602676.422073:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602676.422226:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833782400 00000100:00100000:1.0:1787602676.422240:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833782400 00000100:00100000:1.0:1787602676.422455:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 91 00000100:00100000:1.0:1787602676.422537:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+10:13772:x1874436833782400:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787602676.423010:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+10:13772:x1874436833782400:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 541us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602676.423020:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 91 00000100:00100000:1.0:1787602676.427910:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602676.428916:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833782528 00000100:00100000:0.0:1787602676.428932:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833782528 00000100:00100000:0.0:1787602676.429018:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 92 00000100:00100000:0.0:1787602676.429032:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+10:13772:x1874436833782528:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787602676.433409:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+10:13772:x1874436833782528:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 1945us (3081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602676.433442:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 92 00000100:00100000:3.0:1787602676.457303:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602676.457724:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833782656 00000100:00100000:2.0:1787602676.457740:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833782656 00000100:00100000:2.0:1787602676.457851:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:2.0:1787602676.457863:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2350:x1874436833782656:12345-192.168.201.26@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787602676.457914:0:14422:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 342ec688-1cf5-4965-b127-eb784a25a838@192.168.201.26@tcp t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:2.0:1787602676.458005:0:14422:0:(genops.c:1385:class_connect()) connect: client 342ec688-1cf5-4965-b127-eb784a25a838, cookie 0x3640686da09dc59e 00000004:00100000:2.0:1787602676.458050:0:14422:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787602676.458057:0:14422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1787602676.545173:0:14422:0:(import.c:65:import_set_state_nolock()) ffff8d353465a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602676.545304:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+6:2350:x1874436833782656:12345-192.168.201.26@tcp:38:mount.lustre.0 Request processed in 87439us (88016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602676.545319:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:3.0:1787602676.550097:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602676.550235:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602676.550502:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833782784 00000100:00100000:1.0:1787602676.550516:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833782784 00000100:00100000:1.0:1787602676.550617:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833782912 00000100:00100000:1.0:1787602676.550623:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833782912 00000100:00100000:1.0:1787602676.550659:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:1.0:1787602676.550675:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+7:0:x1874436833782784:12345-192.168.201.26@tcp:41:mount.lustre.0 00000100:00100000:0.0:1787602676.550704:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:0.0:1787602676.550730:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+7:13749:x1874436833782912:12345-192.168.201.26@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787602676.550739:0:14421:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261254144 avail 2259156992 00000004:00000024:0.0:1787602676.550822:0:14422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261254144 avail 2259156992 00000100:00080000:3.0:1787602676.551284:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602676.551399:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+7:0:x1874436833782784:12345-192.168.201.26@tcp:41:mount.lustre.0 Request processed in 716us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602676.551409:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:1.0:1787602676.553997:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+6:13749:x1874436833782912:12345-192.168.201.26@tcp:41:mount.lustre.0 Request processed in 3266us (3750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602676.554028:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:3.0:1787602676.558298:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602676.558436:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833783040 00000100:00100000:1.0:1787602676.558455:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833783040 00000100:00100000:1.0:1787602676.558533:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:1.0:1787602676.558547:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+6:13749:x1874436833783040:12345-192.168.201.26@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787602676.558650:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+6:13749:x1874436833783040:12345-192.168.201.26@tcp:40:mount.lustre.0 Request processed in 106us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602676.558658:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:0.0:1787602676.568163:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602676.568228:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602676.568376:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833783168 00000100:00100000:1.0:1787602676.568387:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833783168 00000100:00100000:1.0:1787602676.568443:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833783296 00000100:00100000:1.0:1787602676.568446:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833783296 00000100:00100000:1.0:1787602676.568461:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:1.0:1787602676.568470:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1874436833783168:12345-192.168.201.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787602676.568506:0:15106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 342ec688-1cf5-4965-b127-eb784a25a838@192.168.201.26@tcp t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:1.0:1787602676.568539:0:15106:0:(genops.c:1385:class_connect()) connect: client 342ec688-1cf5-4965-b127-eb784a25a838, cookie 0x3640686da09dc5a5 00002000:00100000:1.0:1787602676.568551:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 342ec688-1cf5-4965-b127-eb784a25a838/ffff8d3404b11000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787602676.568577:0:15106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787602676.568958:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787602676.568989:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8d35062b6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602676.569051:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:342ec688-1cf5-4965-b127-eb784a25a838+6:2350:x1874436833783168:12345-192.168.201.26@tcp:8:mount.lustre.0 Request processed in 580us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602676.569060:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:1.0:1787602676.569078:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:1.0:1787602676.569083:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1874436833783296:12345-192.168.201.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787602676.569178:0:15106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 342ec688-1cf5-4965-b127-eb784a25a838@192.168.201.26@tcp t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:1.0:1787602676.569210:0:15106:0:(genops.c:1385:class_connect()) connect: client 342ec688-1cf5-4965-b127-eb784a25a838, cookie 0x3640686da09dc5ac 00002000:00100000:1.0:1787602676.569217:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 342ec688-1cf5-4965-b127-eb784a25a838/ffff8d353d1df800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787602676.569223:0:15106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787602676.569452:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787602676.569468:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8d353d1d8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602676.569494:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:342ec688-1cf5-4965-b127-eb784a25a838+6:2350:x1874436833783296:12345-192.168.201.26@tcp:8:mount.lustre.0 Request processed in 409us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602676.569501:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:3.0:1787602676.570521:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602676.570646:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833783424 00000100:00100000:1.0:1787602676.570658:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833783424 00000100:00100000:1.0:1787602676.570706:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:1.0:1787602676.570716:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:342ec688-1cf5-4965-b127-eb784a25a838+6:13749:x1874436833783424:12345-192.168.201.26@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787602676.571644:0:14424:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 834us 00000004:00200000:0.0:1787602676.590476:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787602676.590655:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:342ec688-1cf5-4965-b127-eb784a25a838+6:13749:x1874436833783424:12345-192.168.201.26@tcp:33:mount.lustre.0 Request processed in 19934us (20138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602676.590671:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00010000:00010000:3.0:1787602676.593229:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602676.870435:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602676.873909:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833783552 00000100:00100000:3.0:1787602676.873933:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833783552 00000100:00100000:3.0:1787602676.874038:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:3.0:1787602676.874053:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+6:13793:x1874436833783552:12345-192.168.201.26@tcp:101:mkdir.0 00010000:00010000:3.0:1787602676.874083:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602676.874122:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09dc5b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c27a7 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602676.874216:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dc5ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602676.874232:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dc5ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602676.874249:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dc5ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602676.874546:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787602676.874551:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602676.874662:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dc5ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602676.874701:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432000/0x3640686da09dc5b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c27a7 expref: 8 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602676.874736:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dc5ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c27a7 expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602676.874847:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:3.0:1787602676.874851:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602676.874856:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432e00, rc 0) 00000100:00100000:3.0:1787602676.874956:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+7:13793:x1874436833783552:12345-192.168.201.26@tcp:101:mkdir.0 Request processed in 906us (4535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602676.874964:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:0.0:1787602677.357394:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853702784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787602677.357511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602677.358209:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853702784 00000100:00100000:2.0:1787602677.358221:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853702784 00000100:00100000:2.0:1787602677.358478:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787602677.358492:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853702784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787602677.358526:0:15107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602677.358616:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853702784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602677.358626:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787602677.358717:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853702784:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787602677.359499:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787602677.615419:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602678.639157:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602679.236866:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602679.236961:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833783680 00000100:00100000:3.0:1787602679.236972:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833783680 00000100:00100000:3.0:1787602679.237055:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:3.0:1787602679.237068:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+7:13846:x1874436833783680:12345-192.168.201.26@tcp:41:lfs.0 00000004:00000024:3.0:1787602679.237117:0:15127:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261254144 avail 2259156992 00000100:00100000:3.0:1787602679.237231:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+7:13846:x1874436833783680:12345-192.168.201.26@tcp:41:lfs.0 Request processed in 166us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602679.237239:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00080000:2.0:1787602679.238306:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602679.243322:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602679.243550:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833783808 00000100:00100000:2.0:1787602679.243561:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833783808 00000100:00100000:2.0:1787602679.243641:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:2.0:1787602679.243653:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:342ec688-1cf5-4965-b127-eb784a25a838+6:13846:x1874436833783808:12345-192.168.201.26@tcp:13:lfs.0 00002000:00000024:2.0:1787602679.243704:0:15107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602679.243824:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:342ec688-1cf5-4965-b127-eb784a25a838+6:13846:x1874436833783808:12345-192.168.201.26@tcp:13:lfs.0 Request processed in 172us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602679.243832:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00080000:3.0:1787602679.244675:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787602679.246716:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602679.246931:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833783936 00000100:00100000:2.0:1787602679.246940:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833783936 00000100:00100000:2.0:1787602679.247013:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:2.0:1787602679.247025:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:342ec688-1cf5-4965-b127-eb784a25a838+6:13846:x1874436833783936:12345-192.168.201.26@tcp:13:lfs.0 00002000:00000024:2.0:1787602679.247181:0:15107:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602679.247334:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:342ec688-1cf5-4965-b127-eb784a25a838+6:13846:x1874436833783936:12345-192.168.201.26@tcp:13:lfs.0 Request processed in 311us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602679.247353:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00080000:3.0:1787602679.247682:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602679.458493:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602679.458568:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833784064 00000100:00100000:3.0:1787602679.458583:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833784064 00000100:00100000:3.0:1787602679.458653:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 93 00000100:00100000:3.0:1787602679.458664:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+10:13877:x1874436833784064:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787602679.460085:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602679.460122:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d353d432000/0x3640686da09dc5c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c27ae expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602679.460186:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d432000/0x3640686da09dc5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c27ae expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602679.460200:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d353d432000/0x3640686da09dc5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c27ae expref: 11 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602679.460211:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d432000, rc 0) 00000100:00100000:3.0:1787602679.460321:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+11:13877:x1874436833784064:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 1657us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602679.460330:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 93 00000100:00100000:3.0:1787602679.472363:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602679.473444:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833784192 00000100:00100000:0.0:1787602679.473463:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833784192 00000100:00100000:0.0:1787602679.473552:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 94 00000100:00100000:0.0:1787602679.473584:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+11:13877:x1874436833784192:12345-192.168.201.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787602679.476443:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+11:13877:x1874436833784192:12345-192.168.201.26@tcp:501:mount.lustre.0 Request processed in 2845us (4088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602679.476460:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 94 00000100:00100000:1.0:1787602679.487922:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602679.488081:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833784320 00000100:00100000:2.0:1787602679.488092:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833784320 00000100:00100000:2.0:1787602679.488144:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 95 00000100:00100000:2.0:1787602679.488155:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+11:13877:x1874436833784320:12345-192.168.201.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787602679.488605:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+11:13877:x1874436833784320:12345-192.168.201.26@tcp:503:mount.lustre.0 Request processed in 448us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602679.488613:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 95 00000100:00100000:1.0:1787602679.500080:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602679.500502:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833784448 00000100:00100000:3.0:1787602679.500517:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833784448 00000100:00100000:3.0:1787602679.500595:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 96 00000100:00100000:3.0:1787602679.500613:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+11:13883:x1874436833784448:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787602679.501138:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+11:13883:x1874436833784448:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 527us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602679.501148:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 96 00000001:00100000:1.0:1787602679.540985:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 342ec688-1cf5-4965-b127-eb784a25a838 00000100:00100000:2.0:1787602679.546330:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602679.546461:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833784576 00000100:00100000:3.0:1787602679.546475:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833784576 00000100:00100000:3.0:1787602679.546584:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 97 00000100:00100000:3.0:1787602679.546597:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+11:13883:x1874436833784576:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787602679.547022:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+11:13883:x1874436833784576:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 426us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602679.547033:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 97 00000100:00100000:0.0:1787602679.556465:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602679.556629:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833784704 00000100:00100000:2.0:1787602679.556644:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833784704 00000100:00100000:2.0:1787602679.556714:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 98 00000100:00100000:2.0:1787602679.556727:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+11:13877:x1874436833784704:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787602679.556797:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602679.556822:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3503703200/0x3640686da09dc5c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c27d8 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602679.556858:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503703200/0x3640686da09dc5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c27d8 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602679.556871:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3503703200/0x3640686da09dc5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c27d8 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602679.556882:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503703200, rc 0) 00000100:00100000:2.0:1787602679.559492:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+12:13877:x1874436833784704:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 2747us (3021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602679.559531:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 98 00000100:00100000:1.0:1787602679.586451:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602679.588870:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833784832 00000100:00100000:3.0:1787602679.588892:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833784832 00000100:00100000:3.0:1787602679.588995:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 99 00000100:00100000:3.0:1787602679.589010:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+12:13877:x1874436833784832:12345-192.168.201.26@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787602679.589052:0:14416:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787602679.589092:0:14416:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787602679.589096:0:14416:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787602679.589099:0:14416:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787602679.589102:0:14416:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787602679.598245:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+12:13877:x1874436833784832:12345-192.168.201.26@tcp:256:mount.lustre.0 Request processed in 9220us (11797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602679.598266:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 99 00000100:00100000:0.0:1787602679.606501:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602679.606592:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833784960 00000100:00100000:2.0:1787602679.606608:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833784960 00000100:00100000:2.0:1787602679.606686:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 100 00000100:00100000:2.0:1787602679.606700:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+12:13877:x1874436833784960:12345-192.168.201.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787602679.606725:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602679.606786:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3503702600/0x3640686da09dc5cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c27df expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602679.606824:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3503702600/0x3640686da09dc5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c27df expref: 13 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602679.606837:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3503702600/0x3640686da09dc5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c27df expref: 13 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602679.606848:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702600, rc 0) 00000100:00100000:2.0:1787602679.606921:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:13877:x1874436833784960:12345-192.168.201.26@tcp:101:mount.lustre.0 Request processed in 224us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602679.606928:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 100 00000100:00100000:1.0:1787602679.611970:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602679.612073:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833785088 00000100:00100000:3.0:1787602679.612087:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833785088 00000100:00100000:3.0:1787602679.612184:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 101 00000100:00100000:3.0:1787602679.612197:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:13877:x1874436833785088:12345-192.168.201.26@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787602679.612632:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:13877:x1874436833785088:12345-192.168.201.26@tcp:501:mount.lustre.0 Request processed in 435us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602679.612642:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 101 00000100:00100000:1.0:1787602679.623924:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602679.626405:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833785216 00000100:00100000:2.0:1787602679.626428:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833785216 00000100:00100000:2.0:1787602679.626521:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 102 00000100:00100000:2.0:1787602679.626536:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:13877:x1874436833785216:12345-192.168.201.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787602679.627007:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:13877:x1874436833785216:12345-192.168.201.26@tcp:503:mount.lustre.0 Request processed in 472us (3097us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602679.627017:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 102 00000100:00100000:1.0:1787602679.637075:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602679.637638:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833785344 00000100:00100000:3.0:1787602679.637654:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833785344 00000100:00100000:3.0:1787602679.637736:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 103 00000100:00100000:3.0:1787602679.637797:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:13888:x1874436833785344:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787602679.638189:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:13888:x1874436833785344:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 394us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602679.638200:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 103 00000100:00100000:1.0:1787602679.647898:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602679.648066:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833785472 00000100:00100000:0.0:1787602679.648083:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833785472 00000100:00100000:0.0:1787602679.648167:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 104 00000100:00100000:0.0:1787602679.648179:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:13888:x1874436833785472:12345-192.168.201.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787602679.648550:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:13888:x1874436833785472:12345-192.168.201.26@tcp:502:llog_process_th.0 Request processed in 371us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602679.648559:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 104 00000100:00100000:1.0:1787602679.654390:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00010000:00010000:0.0:1787602679.670201:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602679.671207:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833785600 00000100:00100000:2.0:1787602679.671226:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833785600 00000100:00100000:2.0:1787602679.671304:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:2.0:1787602679.671315:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2350:x1874436833785600:12345-192.168.201.26@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787602679.671368:0:14422:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 01230f64-3401-4225-ba12-2a367927804a@192.168.201.26@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1787602679.671425:0:14422:0:(genops.c:1385:class_connect()) connect: client 01230f64-3401-4225-ba12-2a367927804a, cookie 0x3640686da09dc5d6 00000004:00100000:2.0:1787602679.671470:0:14422:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787602679.673848:0:14422:0:(import.c:65:import_set_state_nolock()) ffff8d35351e7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787602679.673981:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01230f64-3401-4225-ba12-2a367927804a+6:2350:x1874436833785600:12345-192.168.201.26@tcp:38:mount.lustre.0 Request processed in 2659us (19601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602679.673996:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:1.0:1787602679.679230:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602679.679917:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833785728 00000100:00100000:3.0:1787602679.679933:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833785728 00000100:00100000:1.0:1787602679.681380:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00080000:2.0:1787602679.682594:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787602679.684573:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833785856 00000100:00100000:0.0:1787602679.684591:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833785856 00000100:00100000:0.0:1787602679.684696:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:0.0:1787602679.684710:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01230f64-3401-4225-ba12-2a367927804a+7:0:x1874436833785728:12345-192.168.201.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787602679.684772:0:14421:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261254144 avail 2259156992 00000100:00100000:0.0:1787602679.684893:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01230f64-3401-4225-ba12-2a367927804a+7:0:x1874436833785728:12345-192.168.201.26@tcp:41:mount.lustre.0 Request processed in 185us (5691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602679.684900:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:0.0:1787602679.684922:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:0.0:1787602679.684928:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01230f64-3401-4225-ba12-2a367927804a+6:13877:x1874436833785856:12345-192.168.201.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787602679.684939:0:14421:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261254144 avail 2259156992 00000100:00100000:0.0:1787602679.684980:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01230f64-3401-4225-ba12-2a367927804a+6:13877:x1874436833785856:12345-192.168.201.26@tcp:41:mount.lustre.0 Request processed in 52us (3612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602679.684986:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:1.0:1787602679.694679:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602679.695043:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833785984 00000100:00100000:0.0:1787602679.695060:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833785984 00000100:00100000:0.0:1787602679.695161:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:0.0:1787602679.695176:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01230f64-3401-4225-ba12-2a367927804a+6:13877:x1874436833785984:12345-192.168.201.26@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787602679.695329:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01230f64-3401-4225-ba12-2a367927804a+6:13877:x1874436833785984:12345-192.168.201.26@tcp:40:mount.lustre.0 Request processed in 155us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602679.695346:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:3.0:1787602679.700673:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602679.700717:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602679.701507:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833786112 00000100:00100000:1.0:1787602679.701522:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833786112 00000100:00100000:1.0:1787602679.701577:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833786240 00000100:00100000:1.0:1787602679.701580:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833786240 00000100:00100000:1.0:1787602679.701596:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:1.0:1787602679.701606:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1874436833786112:12345-192.168.201.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787602679.701646:0:15106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 01230f64-3401-4225-ba12-2a367927804a@192.168.201.26@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:1.0:1787602679.701698:0:15106:0:(genops.c:1385:class_connect()) connect: client 01230f64-3401-4225-ba12-2a367927804a, cookie 0x3640686da09dc5dd 00002000:00100000:1.0:1787602679.701712:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 01230f64-3401-4225-ba12-2a367927804a/ffff8d353d1da800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787602679.701726:0:15106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787602679.702051:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787602679.702094:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8d353d1da000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602679.702184:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01230f64-3401-4225-ba12-2a367927804a+6:2350:x1874436833786112:12345-192.168.201.26@tcp:8:mount.lustre.0 Request processed in 577us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602679.702192:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:1.0:1787602679.702213:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:1.0:1787602679.702218:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1874436833786240:12345-192.168.201.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787602679.702234:0:15106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 01230f64-3401-4225-ba12-2a367927804a@192.168.201.26@tcp t0 exp 0000000000000000 cur 464 last 0 00000100:00100000:3.0:1787602679.703045:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602679.703541:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833786368 00000100:00100000:2.0:1787602679.703552:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833786368 00000100:00100000:2.0:1787602679.703618:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:2.0:1787602679.703628:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01230f64-3401-4225-ba12-2a367927804a+6:13877:x1874436833786368:12345-192.168.201.26@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787602679.704069:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000020:00000080:1.0:1787602679.705452:0:15106:0:(genops.c:1385:class_connect()) connect: client 01230f64-3401-4225-ba12-2a367927804a, cookie 0x3640686da09dc5e4 00002000:00100000:1.0:1787602679.705473:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 01230f64-3401-4225-ba12-2a367927804a/ffff8d353d1d9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787602679.705489:0:15106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787602679.705624:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787602679.705683:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8d353d1dc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787602679.705771:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01230f64-3401-4225-ba12-2a367927804a+6:2350:x1874436833786240:12345-192.168.201.26@tcp:8:mount.lustre.0 Request processed in 3549us (5050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602679.705783:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:2.0:1787602679.706910:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01230f64-3401-4225-ba12-2a367927804a+6:13877:x1874436833786368:12345-192.168.201.26@tcp:33:mount.lustre.0 Request processed in 612us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602679.706924:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:1.0:1787602680.018147:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602680.018724:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833786496 00000100:00100000:2.0:1787602680.018739:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833786496 00000100:00100000:2.0:1787602680.018862:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:2.0:1787602680.018876:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01230f64-3401-4225-ba12-2a367927804a+6:13909:x1874436833786496:12345-192.168.201.26@tcp:101:mkdir.0 00010000:00010000:2.0:1787602680.018903:0:15127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602680.018935:0:15127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09dc5eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2809 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602680.019035:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc5f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602680.019052:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602680.019069:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602680.020064:0:15127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787602680.020072:0:15127:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602680.020173:0:15127:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602680.020573:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09dc5eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2809 expref: 8 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602680.020603:0:15127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2809 expref: 7 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602680.020615:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:2.0:1787602680.020618:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787602680.020622:0:15127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702e00, rc 0) 00000100:00100000:2.0:1787602680.020723:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01230f64-3401-4225-ba12-2a367927804a+7:13909:x1874436833786496:12345-192.168.201.26@tcp:101:mkdir.0 Request processed in 1849us (2591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602680.020732:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00010000:00010000:3.0:1787602680.685381:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602680.942368:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853703168:0@lo:400:kworker.0 00000100:00100000:3.0:1787602680.942494:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602680.942587:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787602680.942595:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853703040:0@lo:400:kworker.0 00000100:00100000:3.0:1787602680.942625:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602680.942656:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853703552:0@lo:400:kworker.0 00000100:00100000:3.0:1787602680.942688:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602680.943079:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853703168 00000100:00100000:1.0:1787602680.943088:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853703168 00000100:00100000:1.0:1787602680.943158:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853703040 00000100:00100000:1.0:1787602680.943162:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853703040 00000100:00100000:1.0:1787602680.943184:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787602680.943196:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853703168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602680.943268:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853703168:12345-0@lo:400:kworker.0 Request processed in 74us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602680.943277:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787602680.943297:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787602680.943304:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853703040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602680.943347:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853703040:12345-0@lo:400:kworker.0 Request processed in 43us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602680.943354:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787602680.943701:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853703296:0@lo:400:kworker.0 00000100:00100000:0.0:1787602680.943792:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602680.943820:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787602680.943826:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853702912:0@lo:400:kworker.0 00000100:00100000:0.0:1787602680.943860:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602680.943888:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853703424:0@lo:400:kworker.0 00000100:00100000:0.0:1787602680.943920:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602680.943948:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787602680.943958:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35354daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853703680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602680.943988:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602680.944042:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853703680 00000100:00100000:0.0:1787602680.944049:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853703680 00000100:00100000:0.0:1787602680.944082:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787602680.944090:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853703680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787602680.944111:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602680.944155:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853703680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602680.944180:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787602680.944206:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853703552 00000100:00100000:0.0:1787602680.944211:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853703552 00000100:00100000:0.0:1787602680.944249:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853703296 00000100:00100000:0.0:1787602680.944252:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853703296 00000100:00100000:0.0:1787602680.944265:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853703424 00000100:00100000:0.0:1787602680.944268:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853703424 00000100:00100000:0.0:1787602680.944283:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787602680.944289:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853703552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602680.944335:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874436853703552:12345-0@lo:400:kworker.0 Request processed in 46us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602680.944342:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787602680.944355:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787602680.944361:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853703296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602680.944657:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853703296:12345-0@lo:400:kworker.0 Request processed in 295us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602680.944664:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787602680.944678:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787602680.944685:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853703424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602680.944716:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853703424:12345-0@lo:400:kworker.0 Request processed in 32us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602680.944722:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787602680.944796:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35354daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853703680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602680.944836:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853703424:0@lo:400:kworker.0 00000100:00100000:0.0:1787602680.944847:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853703296:0@lo:400:kworker.0 00000100:00080000:2.0:1787602680.949797:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787602680.949813:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787602680.949845:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787602680.949875:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853702912 00000100:00100000:2.0:1787602680.949890:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853702912 00000100:00100000:2.0:1787602680.949963:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787602680.949976:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+19:3303:x1874436853702912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602680.950132:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+19:3303:x1874436853702912:12345-0@lo:400:kworker.0 Request processed in 158us (6270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602680.950141:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787602680.950545:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853703040:0@lo:400:kworker.0 00000100:00100000:3.0:1787602680.950565:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1874436853703552:0@lo:400:kworker.0 00000100:00100000:3.0:1787602680.950577:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853703168:0@lo:400:kworker.0 00000100:00100000:1.0:1787602680.951016:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853702912:0@lo:400:kworker.0 00000001:00100000:0.0:1787602681.557073:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 01230f64-3401-4225-ba12-2a367927804a 00000001:00100000:0.0:1787602681.557099:0:7646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 342ec688-1cf5-4965-b127-eb784a25a838 00010000:00010000:0.0:1787602681.709048:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787602682.046528:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 342ec688-1cf5-4965-b127-eb784a25a838 00000001:00100000:2.0:1787602682.046607:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 01230f64-3401-4225-ba12-2a367927804a 00000100:00100000:3.0:1787602682.477142:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787602682.477176:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853703808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602682.477305:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602682.477492:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853703808 00000100:00100000:0.0:1787602682.477504:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853703808 00000100:00100000:0.0:1787602682.477591:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787602682.477606:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853703808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787602682.477655:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787602682.477717:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853703808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602682.477726:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787602682.477900:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787602682.478049:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853703808:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787602682.733001:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787602683.378830:0:16384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787602683.756996:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787602684.461578:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1787602684.650132:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 01230f64-3401-4225-ba12-2a367927804a 00010000:00010000:0.0:1787602684.781946:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602685.146962:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602685.147013:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602685.147045:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602685.147066:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602685.147088:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602685.147109:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602685.147135:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602685.147167:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833786880 00000100:00100000:0.0:1787602685.147180:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833786880 00000100:00100000:0.0:1787602685.147265:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833787392 00000100:00100000:0.0:1787602685.147269:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833787392 00000100:00100000:0.0:1787602685.147287:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833787008 00000100:00100000:0.0:1787602685.147289:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833787008 00000100:00100000:0.0:1787602685.147305:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833787264 00000100:00100000:0.0:1787602685.147307:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833787264 00000100:00100000:0.0:1787602685.147326:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:0.0:1787602685.147349:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:342ec688-1cf5-4965-b127-eb784a25a838+5:2352:x1874436833786880:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602685.147448:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:342ec688-1cf5-4965-b127-eb784a25a838+5:2352:x1874436833786880:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 103us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602685.147456:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:0.0:1787602685.147475:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:0.0:1787602685.147483:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01230f64-3401-4225-ba12-2a367927804a+5:2352:x1874436833787392:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602685.147510:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405082d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01230f64-3401-4225-ba12-2a367927804a+5:2352:x1874436833787392:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 28us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602685.147516:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:0.0:1787602685.147527:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:0.0:1787602685.147534:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:342ec688-1cf5-4965-b127-eb784a25a838+5:2352:x1874436833787008:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602685.147557:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:342ec688-1cf5-4965-b127-eb784a25a838+5:2352:x1874436833787008:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 24us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602685.147563:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:0.0:1787602685.147574:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:0.0:1787602685.147581:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01230f64-3401-4225-ba12-2a367927804a+5:2352:x1874436833787264:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602685.147604:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01230f64-3401-4225-ba12-2a367927804a+5:2352:x1874436833787264:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 23us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602685.147610:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:0.0:1787602685.147633:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833787136 00000100:00100000:0.0:1787602685.147637:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833787136 00000100:00100000:0.0:1787602685.147669:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833786752 00000100:00100000:0.0:1787602685.147672:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833786752 00000100:00100000:0.0:1787602685.147696:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:0.0:1787602685.147711:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01230f64-3401-4225-ba12-2a367927804a+6:2352:x1874436833787136:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602685.147779:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01230f64-3401-4225-ba12-2a367927804a+6:2352:x1874436833787136:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 70us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602685.147787:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:0.0:1787602685.147800:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:0.0:1787602685.147807:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+6:2352:x1874436833786752:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602685.147833:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+6:2352:x1874436833786752:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 27us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602685.147839:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00080000:0.0:1787602685.147870:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787602685.147875:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787602685.147878:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602685.152701:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833786624 00000100:00100000:2.0:1787602685.152723:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833786624 00000100:00100000:2.0:1787602685.152892:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 106 00000100:00100000:2.0:1787602685.152909:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:2352:x1874436833786624:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602685.153027:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:2352:x1874436833786624:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 122us (6081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602685.153036:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 106 00010000:00010000:0.0:1787602685.807134:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602686.061128:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853704064:0@lo:400:kworker.0 00000100:00100000:0.0:1787602686.061224:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602686.061303:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874436853704576:0@lo:400:kworker.0 00000100:00100000:0.0:1787602686.061332:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602686.061362:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787602686.061369:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853704192:0@lo:400:kworker.0 00000100:00100000:0.0:1787602686.061393:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602686.061442:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853704064 00000100:00100000:0.0:1787602686.061451:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853704064 00000100:00100000:0.0:1787602686.061521:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853704192 00000100:00100000:0.0:1787602686.061525:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853704192 00000100:00100000:0.0:1787602686.061549:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787602686.061722:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853704064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602686.061875:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853704064:12345-0@lo:400:kworker.0 Request processed in 156us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602686.061883:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787602686.061905:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787602686.061911:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853704192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602686.061942:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853704192:12345-0@lo:400:kworker.0 Request processed in 32us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602686.061948:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787602686.061970:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853704576 00000100:00100000:0.0:1787602686.061974:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853704576 00000100:00100000:0.0:1787602686.062006:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787602686.062013:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874436853704576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787602686.062042:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874436853704576:12345-0@lo:400:kworker.0 Request processed in 31us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602686.062048:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787602686.062068:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787602686.062073:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787602686.062076:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602686.062711:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853704320:0@lo:400:kworker.0 00000100:00100000:1.0:1787602686.062789:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602686.062827:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787602686.062835:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853703936:0@lo:400:kworker.0 00000100:00100000:1.0:1787602686.062866:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602686.062894:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853704448:0@lo:400:kworker.0 00000100:00100000:1.0:1787602686.062919:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602686.062993:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853704320 00000100:00100000:1.0:1787602686.062998:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853704320 00000100:00100000:1.0:1787602686.063032:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853704448 00000100:00100000:1.0:1787602686.063035:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853704448 00000100:00100000:1.0:1787602686.063062:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787602686.063070:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35354daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853704320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602686.063129:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35354daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874436853704320:12345-0@lo:400:kworker.0 Request processed in 47us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602686.063137:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787602686.063152:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787602686.063158:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853704448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602686.063188:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853704448:12345-0@lo:400:kworker.0 Request processed in 31us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602686.063194:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787602686.063214:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853703936 00000100:00100000:1.0:1787602686.063218:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853703936 00000100:00100000:1.0:1787602686.063260:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787602686.063267:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35035a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+19:3303:x1874436853703936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602686.063298:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35035a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+19:3303:x1874436853703936:12345-0@lo:400:kworker.0 Request processed in 33us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602686.063314:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787602686.063357:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405fa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853704704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602686.063387:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602686.063431:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853704704 00000100:00100000:1.0:1787602686.063435:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853704704 00000100:00100000:1.0:1787602686.063467:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787602686.063488:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853704704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602686.063529:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602686.063721:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853704704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 248us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602686.063729:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787602686.063774:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602686.063816:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405fa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853704704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787602686.063856:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853703936:0@lo:400:kworker.0 00000100:00100000:1.0:1787602686.063869:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853704448:0@lo:400:kworker.0 00000100:00100000:1.0:1787602686.063879:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874436853704320:0@lo:400:kworker.0 00000100:00100000:0.0:1787602686.064272:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853704192:0@lo:400:kworker.0 00000100:00100000:0.0:1787602686.064293:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853704064:0@lo:400:kworker.0 00000100:00100000:0.0:1787602686.064307:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1874436853704576:0@lo:400:kworker.0 00010000:00010000:0.0:1787602686.828968:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787602687.415043:0:16533:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff02868b50 20000000:00000080:3.0:1787602687.415061:0:16533:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d34075c6800 uarg=0000000000000000 20000000:01000000:3.0:1787602687.415095:0:16533:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787602687.415101:0:16533:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787602687.415106:0:16533:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787602687.416619:0:16534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787602687.421416:0:16533:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787602687.431106:0:16533:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787602687.431704:0:16533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d35354e2800/0x3640686da09dc5f9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602687.431729:0:16533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d35378e4e00/0x3640686da09dc2f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc2e9 expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602687.431786:0:16533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d353d433000/0x3640686da09dc33d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc336 expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602687.431792:0:16533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d35354eb800/0x3640686da09dc471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc46a expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602687.431802:0:16533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3406857e00/0x3640686da09dc597 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c277d expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602687.431811:0:16533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d3503702600/0x3640686da09dc5cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c27df expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602687.431820:0:16533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d35354e2800/0x3640686da09dc5f9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602687.431871:0:16533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3503702600/0x3640686da09dc5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c27df expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602687.431885:0:16533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3503702600/0x3640686da09dc5cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c27df expref: 12 pid: 14415 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602687.431901:0:16533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16533:1874436853704832:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787602687.432011:0:16533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d3406857e00/0x3640686da09dc597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c277d expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602687.432021:0:16533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d3406857e00/0x3640686da09dc597 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c277d expref: 12 pid: 14415 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602687.432030:0:16533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16533:1874436853704960:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787602687.432082:0:16533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d35354eb800/0x3640686da09dc471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09dc46a expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602687.432091:0:16533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d35354eb800/0x3640686da09dc471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09dc46a expref: 18 pid: 14414 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602687.432101:0:16533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16533:1874436853705088:0@lo:104: 00000100:00100000:0.0:1787602687.432141:0:16533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602687.432181:0:16533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d353d433000/0x3640686da09dc33d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09dc336 expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602687.432189:0:16533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d353d433000/0x3640686da09dc33d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09dc336 expref: 18 pid: 14415 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602687.432197:0:16533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16533:1874436853705216:0@lo:104: 00000100:00100000:0.0:1787602687.432228:0:16533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787602687.432263:0:16533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d35378e4e00/0x3640686da09dc2f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3640686da09dc2e9 expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602687.432272:0:16533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d35378e4e00/0x3640686da09dc2f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3640686da09dc2e9 expref: 18 pid: 14414 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602687.432280:0:16533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16533:1874436853705344:0@lo:104: 00000100:00100000:0.0:1787602687.432306:0:16533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602687.432310:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853705088 00000100:00100000:2.0:1787602687.432319:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853705088 00000100:00100000:0.0:1787602687.432323:0:16533:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a108540 going to sleep for 11 seconds 00000100:00100000:2.0:1787602687.432367:0:14405:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787602687.432379:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853705216 00000100:00100000:2.0:1787602687.432381:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853705216 00000100:00100000:2.0:1787602687.432394:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853705344 00000100:00100000:2.0:1787602687.432397:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853705344 00000100:00100000:2.0:1787602687.432411:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787602687.432434:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:704a385b-7757-43d8-8441-546b4c8b60c7+5:16533:x1874436853705088:12345-0@lo:104: 00010000:00010000:2.0:1787602687.432454:0:14405:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d35354e3800/0x3640686da09dc46a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dc471 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602687.433269:0:14405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787602687.433280:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:704a385b-7757-43d8-8441-546b4c8b60c7+5:16533:x1874436853705088:12345-0@lo:104: Request processed in 858us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602687.433289:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787602687.433329:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787602687.433337:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:704a385b-7757-43d8-8441-546b4c8b60c7+4:16533:x1874436853705216:12345-0@lo:104: 00010000:00010000:0.0:1787602687.433348:0:14405:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d35354e3c00/0x3640686da09dc336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dc33d expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602687.433391:0:14405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787602687.433397:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:704a385b-7757-43d8-8441-546b4c8b60c7+4:16533:x1874436853705216:12345-0@lo:104: Request processed in 62us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602687.433402:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787602687.433418:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787602687.433426:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3404242050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:704a385b-7757-43d8-8441-546b4c8b60c7+3:16533:x1874436853705344:12345-0@lo:104: 00010000:00010000:2.0:1787602687.433430:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787602687.433433:0:14405:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.126@tcp lock: ffff8d353d433200/0x3640686da09dc2e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dc2f0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.433439:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d35354e3800/0x3640686da09dc46a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dc471 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.433450:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3800 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:2.0:1787602687.433455:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d35354e3800/0x3640686da09dc46a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09dc471 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.433463:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d35354e3800/0x3640686da09dc46a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09dc471 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602687.433465:0:14405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787602687.433472:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3404242050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:704a385b-7757-43d8-8441-546b4c8b60c7+3:16533:x1874436853705344:12345-0@lo:104: Request processed in 47us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602687.433479:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 10000000:00010000:2.0:1787602687.433488:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d35354e3800/0x3640686da09dc46a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09dc471 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602687.433494:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787602687.433529:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d35354e3800/0x3640686da09dc46a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc471 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.433535:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787602687.433552:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d35354e3800/0x3640686da09dc46a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc471 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.433559:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d35354e3800/0x3640686da09dc46a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc471 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.433573:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787602687.433577:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d35354e3c00/0x3640686da09dc336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dc33d expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602687.433630:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787602687.433658:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853705472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787602687.433692:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787602687.433821:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3c00 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:2.0:1787602687.433825:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d35354e3c00/0x3640686da09dc336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09dc33d expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.433833:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d35354e3c00/0x3640686da09dc336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09dc33d expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787602687.433839:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d35354e3c00/0x3640686da09dc336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09dc33d expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787602687.433845:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787602687.433868:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d35354e3c00/0x3640686da09dc336 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc33d expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.433874:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787602687.433878:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853705472 00000100:00100000:1.0:1787602687.433885:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853705472 00010000:00010000:2.0:1787602687.433887:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d35354e3c00/0x3640686da09dc336 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc33d expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.433896:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d35354e3c00/0x3640686da09dc336 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc33d expref: -99 pid: 15102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.433907:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602687.433909:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d35354eb800/0x3640686da09dc471 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dc46a expref: 19 pid: 14414 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.433910:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602687.433913:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602687.433949:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787602687.433963:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704a385b-7757-43d8-8441-546b4c8b60c7+19:3303:x1874436853705472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787602687.433974:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602687.433979:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d35354eb800/0x3640686da09dc471 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dc46a expref: 19 pid: 14414 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602687.433989:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d35354eb800/0x3640686da09dc471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09dc46a expref: 19 pid: 14414 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602687.434005:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602687.434030:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:704a385b-7757-43d8-8441-546b4c8b60c7+19:3303:x1874436853705472:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602687.434036:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787602687.434067:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853705472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787602687.434081:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787602687.434087:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853705600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787602687.434108:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602687.434178:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853705600 00000100:00100000:2.0:1787602687.434183:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853705600 00010000:00010000:2.0:1787602687.434224:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d353d433000/0x3640686da09dc33d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dc336 expref: 19 pid: 14415 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602687.434241:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d35354eb800/0x3640686da09dc471 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09dc46a expref: 19 pid: 14414 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602687.434254:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787602687.434256:0:16533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16533:1874436853705088:0@lo:104: 00000100:00100000:3.0:1787602687.434267:0:16533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16533:1874436853705216:0@lo:104: 00000100:00100000:2.0:1787602687.434272:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704a385b-7757-43d8-8441-546b4c8b60c7+18:3303:x1874436853705600:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602687.434279:0:16533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16533:1874436853705344:0@lo:104: 00010000:00010000:2.0:1787602687.434413:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602687.434416:0:16535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602687.434419:0:16535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787602687.434421:0:16535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602687.434434:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d353d433000/0x3640686da09dc33d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dc336 expref: 18 pid: 14415 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.434446:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d353d433000/0x3640686da09dc33d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09dc336 expref: 18 pid: 14415 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602687.434451:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.126@tcp lock: ffff8d353d433200/0x3640686da09dc2e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3640686da09dc2f0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.434461:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d353d433000/0x3640686da09dc33d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09dc336 expref: 18 pid: 14415 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602687.434463:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433200 already unused, calling callback (ffffffffc1c3ec20) 10000000:00010000:1.0:1787602687.434469:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.126@tcp lock: ffff8d353d433200/0x3640686da09dc2e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3640686da09dc2f0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602687.434477:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.126@tcp lock: ffff8d353d433200/0x3640686da09dc2e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3640686da09dc2f0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787602687.434484:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.126@tcp lock: ffff8d353d433200/0x3640686da09dc2e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3640686da09dc2f0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602687.434500:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787602687.434536:0:14410:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.126@tcp lock: ffff8d353d433200/0x3640686da09dc2e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc2f0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602687.434543:0:14410:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787602687.434560:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.126@tcp lock: ffff8d353d433200/0x3640686da09dc2e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc2f0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602687.434574:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.126@tcp lock: ffff8d353d433200/0x3640686da09dc2e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3640686da09dc2f0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.434579:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602687.434588:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602687.434590:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787602687.434591:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602687.434600:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:704a385b-7757-43d8-8441-546b4c8b60c7:3301:1874436853705728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787602687.434626:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602687.434658:0:14407:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787602687.434665:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1787602687.434823:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704a385b-7757-43d8-8441-546b4c8b60c7+17:3303:x1874436853705600:12345-0@lo:103:ldlm_bl.0 Request processed in 555us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602687.434831:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787602687.434848:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853705728 00000100:00100000:2.0:1787602687.434853:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853705728 00010000:00010000:2.0:1787602687.434868:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d35378e4e00/0x3640686da09dc2f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dc2e9 expref: 17 pid: 14414 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602687.434898:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787602687.434906:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3504d84c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704a385b-7757-43d8-8441-546b4c8b60c7+17:3301:x1874436853705728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787602687.434915:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602687.434921:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d35378e4e00/0x3640686da09dc2f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3640686da09dc2e9 expref: 17 pid: 14414 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.434929:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d35378e4e00/0x3640686da09dc2f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3640686da09dc2e9 expref: 17 pid: 14414 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.434942:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d35378e4e00/0x3640686da09dc2f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3640686da09dc2e9 expref: 17 pid: 14414 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.434961:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602687.440058:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853705600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602687.440352:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3504d84c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:704a385b-7757-43d8-8441-546b4c8b60c7+16:3301:x1874436853705728:12345-0@lo:103:ldlm_bl.0 Request processed in 5445us (5722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602687.440370:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787602687.448723:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:704a385b-7757-43d8-8441-546b4c8b60c7:3301:1874436853705728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787602687.462537:0:16533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16533:1874436853704832:192.168.201.26@tcp:104: 00000100:00100000:1.0:1787602687.470166:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602687.470381:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833787520 00000100:00100000:3.0:1787602687.470392:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833787520 00010000:00010000:3.0:1787602687.470478:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3503702600/0x3640686da09dc5cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c27df expref: 13 pid: 14415 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602687.470530:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:3.0:1787602687.470542:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:2351:x1874436833787520:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602687.470556:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602687.470562:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3503702600/0x3640686da09dc5cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c27df expref: 13 pid: 14415 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602687.470575:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3503702600/0x3640686da09dc5cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c27df expref: 13 pid: 14415 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602687.470593:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3503702600/0x3640686da09dc5cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c27df expref: 13 pid: 14415 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602687.470625:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602687.470698:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+12:2351:x1874436833787520:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 157us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602687.470707:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:0.0:1787602687.474177:0:16533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16533:1874436853704960:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787602687.474237:0:16533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d35354e2800/0x3640686da09dc5f9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602687.482423:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602687.482538:0:16536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833787648 00000100:00100000:3.0:1787602687.482558:0:16536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833787648 00010000:00010000:3.0:1787602687.482597:0:16536:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d3406857e00/0x3640686da09dc597 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c277d expref: 12 pid: 14415 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602687.482650:0:16536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:3.0:1787602687.482666:0:16536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+12:2352:x1874436833787648:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602687.482681:0:16536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602687.482687:0:16536:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d3406857e00/0x3640686da09dc597 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c277d expref: 12 pid: 14415 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602687.482700:0:16536:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d3406857e00/0x3640686da09dc597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c277d expref: 12 pid: 14415 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602687.482720:0:16536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d3406857e00/0x3640686da09dc597 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c277d expref: 12 pid: 14415 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602687.482786:0:16536:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d35354e2800/0x3640686da09dc5f9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602687.482795:0:16536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35354e2800/0x3640686da09dc5f9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602687.482812:0:16536:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d35354e2800/0x3640686da09dc5f9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602687.482834:0:16536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d35354e2800/0x3640686da09dc5f9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602687.482841:0:16536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d35354e2800/0x3640686da09dc5f9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602687.482848:0:16536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d35354e2800/0x3640686da09dc5f9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602687.482854:0:16536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e2800 already unused, calling callback (ffffffffc1656230) 00010000:00010000:3.0:1787602687.482859:0:16536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d35354e2800/0x3640686da09dc5f9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602687.482867:0:16536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d35354e2800/0x3640686da09dc5f9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602687.482895:0:16536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d35354e2800/0x3640686da09dc5f9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602687.482908:0:16536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602687.482957:0:16536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+11:2352:x1874436833787648:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 298us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602687.482964:0:16536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 8 00010000:00010000:2.0:1787602687.483258:0:16533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d35354e2800/0x3640686da09dc5f9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.483270:0:16533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d35354e2800/0x3640686da09dc5f9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602687.483277:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d35354e2800/0x3640686da09dc5f9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602687.597102:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853705856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602687.597173:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602687.598918:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853705856 00000100:00100000:3.0:1787602687.598932:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853705856 00000100:00100000:3.0:1787602687.598996:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787602687.599007:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853705856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602687.599046:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602687.599139:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853705856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (1965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602687.599161:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787602687.599263:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853705856:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787602687.852989:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602688.858270:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602688.858344:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833787776 00000100:00100000:1.0:1787602688.858354:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833787776 00000100:00100000:1.0:1787602688.858406:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 108 00000100:00100000:1.0:1787602688.858416:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+11:13763:x1874436833787776:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602688.858445:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602688.858465:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3406856600/0x3640686da09dc600 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2810 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602688.858490:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3406856600/0x3640686da09dc600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2810 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602688.858501:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3406856600/0x3640686da09dc600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2810 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602688.858510:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3406856600, rc 0) 00000100:00100000:1.0:1787602688.858567:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+12:13763:x1874436833787776:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 Request processed in 152us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602688.858575:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 108 00000100:00100000:1.0:1787602688.866346:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602688.866418:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833787904 00000100:00100000:2.0:1787602688.866427:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833787904 00000100:00100000:2.0:1787602688.866481:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 109 00000100:00100000:2.0:1787602688.866491:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+12:13763:x1874436833787904:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787602688.867381:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+12:13763:x1874436833787904:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 Request processed in 887us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602688.867393:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 109 00010000:00010000:0.0:1787602688.879420:0:16535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602688.879530:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602688.881120:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833788032 00000100:00100000:3.0:1787602688.881135:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833788032 00000100:00100000:3.0:1787602688.881208:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 110 00000100:00100000:3.0:1787602688.881220:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+12:13763:x1874436833788032:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602688.881464:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+12:13763:x1874436833788032:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 Request processed in 245us (1940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602688.881472:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 110 00000100:00100000:0.0:1787602688.895593:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602688.895711:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833788160 00000100:00100000:3.0:1787602688.895722:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833788160 00000100:00100000:3.0:1787602688.895808:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 111 00000100:00100000:3.0:1787602688.895819:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+12:13763:x1874436833788160:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602688.895839:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602688.895859:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d353d433c00/0x3640686da09dc607 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2817 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602688.895886:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d353d433c00/0x3640686da09dc607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2817 expref: 13 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602688.895898:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d353d433c00/0x3640686da09dc607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2817 expref: 13 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602688.895908:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433c00, rc 0) 00000100:00100000:3.0:1787602688.895967:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:13763:x1874436833788160:12345-192.168.201.26@tcp:101:ll_cfg_requeue.0 Request processed in 150us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602688.896000:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 111 00000100:00100000:3.0:1787602688.906003:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602688.908193:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833788288 00000100:00100000:1.0:1787602688.908208:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833788288 00000100:00100000:1.0:1787602688.908268:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 112 00000100:00100000:1.0:1787602688.908280:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:13763:x1874436833788288:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602688.908599:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:13763:x1874436833788288:12345-192.168.201.26@tcp:501:ll_cfg_requeue.0 Request processed in 320us (2611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602688.908610:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 112 00000100:00100000:1.0:1787602688.919126:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602688.919276:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833788416 00000100:00100000:2.0:1787602688.919289:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833788416 00000100:00100000:2.0:1787602688.919365:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 113 00000100:00100000:2.0:1787602688.919378:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:13763:x1874436833788416:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602688.919779:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:13763:x1874436833788416:12345-192.168.201.26@tcp:503:ll_cfg_requeue.0 Request processed in 401us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602688.919791:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 113 10000000:01000000:3.0:1787602689.261125:0:14419:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787602689.261140:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3505485000 from 10 10000000:01000000:3.0:1787602689.261149:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787602689.261243:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d353d432200/0x3640686da09dc60e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602689.261259:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d353d432200/0x3640686da09dc60e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602689.261275:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d353d432200/0x3640686da09dc60e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602689.261313:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853705984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787602689.261425:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602689.261513:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3529f31600 going to sleep for 11 seconds 00000100:00100000:1.0:1787602689.261591:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853705984 00000100:00100000:1.0:1787602689.261602:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853705984 00000100:00100000:1.0:1787602689.261666:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787602689.261700:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+16:14419:x1874436853705984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602689.261718:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602689.261734:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3406857800/0x3640686da09dc615 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc60e expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602689.261796:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3406857800/0x3640686da09dc615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc60e expref: 17 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602689.261811:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3406857800/0x3640686da09dc615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc60e expref: 17 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602689.261824:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3406857800, rc 0) 00000100:00100000:1.0:1787602689.261885:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+17:14419:x1874436853705984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602689.261893:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787602689.262106:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853705984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602689.262123:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d353d432200/0x3640686da09dc60e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc615 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602689.262133:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d353d432200/0x3640686da09dc60e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc615 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602689.262215:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853706112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602689.262247:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602689.262283:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3529f31600 going to sleep for 11 seconds 00000100:00100000:1.0:1787602689.262759:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853706112 00000100:00100000:1.0:1787602689.262766:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853706112 00000100:00100000:1.0:1787602689.262815:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787602689.262825:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+17:14419:x1874436853706112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602689.264214:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+17:14419:x1874436853706112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1381us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602689.264227:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787602689.265110:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853706112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602689.265232:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853706240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602689.265398:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602689.265468:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3529f31600 going to sleep for 11 seconds 00000100:00100000:1.0:1787602689.265669:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853706240 00000100:00100000:1.0:1787602689.265678:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853706240 00000100:00100000:1.0:1787602689.265859:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787602689.265871:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+17:14419:x1874436853706240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602689.266144:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+17:14419:x1874436853706240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 275us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602689.266162:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787602689.266293:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853706240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787602689.281771:0:16603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787602689.283448:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787602689.283787:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787602689.283803:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d353d432200/0x3640686da09dc60e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc615 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602689.283819:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d353d432200/0x3640686da09dc60e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc615 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787602689.283832:0:14419:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787602689.283836:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d3534816800 from 10 10000000:01000000:0.0:1787602689.283839:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787602689.283893:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc61c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602689.283903:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc61c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602689.283917:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc61c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602689.285202:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853706368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787602689.285343:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787602689.285400:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a108000 going to sleep for 11 seconds 00000100:00100000:1.0:1787602689.285607:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853706368 00000100:00100000:1.0:1787602689.285618:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853706368 00000100:00100000:1.0:1787602689.285694:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787602689.285707:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+17:14419:x1874436853706368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602689.285730:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602689.285777:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d3406856000/0x3640686da09dc623 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc61c expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602689.285812:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d3406856000/0x3640686da09dc623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc61c expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602689.285825:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d3406856000/0x3640686da09dc623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc61c expref: 18 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602689.285836:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3406856000, rc 0) 00000100:00100000:1.0:1787602689.285892:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+18:14419:x1874436853706368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602689.285899:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787602689.285970:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853706368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787602689.285989:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc61c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc623 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602689.285999:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc61c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc623 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602689.286087:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405fa5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853706496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602689.286134:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602689.286158:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35034b60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602689.286186:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853706496 00000100:00100000:1.0:1787602689.286190:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853706496 00000100:00100000:1.0:1787602689.286216:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787602689.286223:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+18:14419:x1874436853706496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602689.295674:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+18:14419:x1874436853706496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 9420us (9508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602689.295694:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787602689.295823:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405fa5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853706496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602689.295904:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405fa5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853706624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602689.295974:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602689.296019:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35034b60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602689.296041:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853706624 00000100:00100000:1.0:1787602689.296051:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853706624 00000100:00100000:1.0:1787602689.296104:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787602689.296115:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+18:14419:x1874436853706624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787602689.296360:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+18:14419:x1874436853706624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602689.296368:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787602689.296378:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405fa5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853706624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787602689.297862:0:16604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787602689.299539:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787602689.299586:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787602689.299602:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc61c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc623 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602689.299616:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d35354e2800/0x3640686da09dc61c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc623 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787602689.299648:0:14419:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787602689.299652:0:14419:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d353cc8e000 from 10 10000000:01000000:1.0:1787602689.299656:0:14419:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787602689.299706:0:14419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3406856400/0x3640686da09dc62a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602689.299714:0:14419:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.126@tcp lock: ffff8d3406856400/0x3640686da09dc62a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602689.299726:0:14419:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.126@tcp lock: ffff8d3406856400/0x3640686da09dc62a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602689.299799:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405fa7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853706752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787602689.299898:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602689.299957:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35034b6840 going to sleep for 11 seconds 00000100:00100000:0.0:1787602689.301083:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853706752 00000100:00100000:0.0:1787602689.301098:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853706752 00000100:00100000:0.0:1787602689.301189:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787602689.301203:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+18:14419:x1874436853706752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787602689.301225:0:14416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602689.301250:0:14416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d35354e3c00/0x3640686da09dc631 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3640686da09dc62a expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602689.301306:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d35354e3c00/0x3640686da09dc631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3640686da09dc62a expref: 19 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602689.301319:0:14416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d35354e3c00/0x3640686da09dc631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3640686da09dc62a expref: 19 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602689.301330:0:14416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e3c00, rc 0) 00000100:00100000:0.0:1787602689.301419:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:704a385b-7757-43d8-8441-546b4c8b60c7+19:14419:x1874436853706752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602689.301427:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787602689.301898:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405fa7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853706752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787602689.301924:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.126@tcp lock: ffff8d3406856400/0x3640686da09dc62a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc631 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602689.301936:0:14419:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.126@tcp lock: ffff8d3406856400/0x3640686da09dc62a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3640686da09dc631 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602689.302026:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853706880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602689.302070:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602689.302103:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3529f31840 going to sleep for 11 seconds 00000100:00100000:1.0:1787602689.302161:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853706880 00000100:00100000:1.0:1787602689.302169:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853706880 00000100:00100000:1.0:1787602689.302223:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787602689.302232:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+19:14419:x1874436853706880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787602689.302734:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+19:14419:x1874436853706880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 500us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602689.302778:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787602689.317562:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853706880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787602689.317649:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853707008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787602689.317786:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602689.317840:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3529f31840 going to sleep for 11 seconds 00000100:00100000:2.0:1787602689.318058:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853707008 00000100:00100000:2.0:1787602689.318076:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853707008 00000100:00100000:2.0:1787602689.318825:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787602689.318843:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353cfdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+19:14419:x1874436853707008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787602689.319146:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353cfdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+19:14419:x1874436853707008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 308us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602689.319155:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787602689.319506:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:704a385b-7757-43d8-8441-546b4c8b60c7:14419:1874436853707008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787602689.320808:0:16605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787602689.321041:0:14419:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787602689.321068:0:14419:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787602689.321084:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.126@tcp lock: ffff8d3406856400/0x3640686da09dc62a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc631 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602689.321125:0:14419:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.126@tcp lock: ffff8d3406856400/0x3640686da09dc62a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3640686da09dc631 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602689.902175:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602690.260307:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602690.260349:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602690.260471:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833788672 00000100:00100000:0.0:1787602690.260483:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833788672 00000100:00100000:0.0:1787602690.260561:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:0.0:1787602690.260572:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+6:2352:x1874436833788672:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:0.0:1787602690.260663:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+6:2352:x1874436833788672:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 93us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602690.260671:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:1.0:1787602690.261515:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00080000:3.0:1787602690.261903:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602690.263069:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602690.263100:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602690.263507:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833788928 00000100:00100000:2.0:1787602690.263517:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833788928 00000100:00100000:2.0:1787602690.263580:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833789184 00000100:00100000:2.0:1787602690.263583:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833789184 00000100:00100000:2.0:1787602690.263599:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:2.0:1787602690.263608:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:342ec688-1cf5-4965-b127-eb784a25a838+5:2352:x1874436833788928:12345-192.168.201.26@tcp:400:kworker.0 00000100:00080000:3.0:1787602690.263723:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787602690.263728:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602690.263778:0:15105:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787602690.263787:0:15105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787602690.263899:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:3.0:1787602690.263907:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:01230f64-3401-4225-ba12-2a367927804a+5:2352:x1874436833789184:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602690.263959:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:01230f64-3401-4225-ba12-2a367927804a+5:2352:x1874436833789184:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 52us (2446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602690.263966:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:3.0:1787602690.264179:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833788544 00000100:00100000:3.0:1787602690.264184:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833788544 00000100:00100000:3.0:1787602690.264557:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 123 00000100:00100000:3.0:1787602690.264566:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:2352:x1874436833788544:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602690.264602:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:2352:x1874436833788544:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 37us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602690.264610:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 123 00000100:00100000:2.0:1787602690.269178:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:342ec688-1cf5-4965-b127-eb784a25a838+5:2352:x1874436833788928:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 5548us (8805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602690.269194:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:1.0:1787602690.270600:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602690.270670:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602690.270842:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833789056 00000100:00100000:2.0:1787602690.270853:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833789056 00000100:00100000:2.0:1787602690.270920:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00100000:2.0:1787602690.270930:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01230f64-3401-4225-ba12-2a367927804a+6:2352:x1874436833789056:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:2.0:1787602690.270995:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01230f64-3401-4225-ba12-2a367927804a+6:2352:x1874436833789056:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 67us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602690.271003:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00100000:3.0:1787602690.271150:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833788800 00000100:00100000:3.0:1787602690.271164:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833788800 00000100:00100000:3.0:1787602690.271193:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833789312 00000100:00100000:3.0:1787602690.271195:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833789312 00000100:00100000:3.0:1787602690.271226:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:3.0:1787602690.271233:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:342ec688-1cf5-4965-b127-eb784a25a838+5:2352:x1874436833788800:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602690.271291:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:342ec688-1cf5-4965-b127-eb784a25a838+5:2352:x1874436833788800:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 58us (8190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602690.271298:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:3.0:1787602690.271310:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:3.0:1787602690.271317:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:01230f64-3401-4225-ba12-2a367927804a+5:2352:x1874436833789312:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602690.271341:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:01230f64-3401-4225-ba12-2a367927804a+5:2352:x1874436833789312:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 24us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602690.271347:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00080000:1.0:1787602690.271861:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787602690.271866:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602690.271868:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787602690.925027:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602691.181238:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3405fa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853707136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602691.181330:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602691.181406:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787602691.181430:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853707264:0@lo:400:kworker.0 00000100:00100000:3.0:1787602691.181467:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853707136 00000100:00100000:2.0:1787602691.181471:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602691.181476:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853707136 00000100:00100000:2.0:1787602691.181502:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853707648:0@lo:400:kworker.0 00000100:00100000:2.0:1787602691.181534:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602691.181557:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787602691.181559:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787602691.181566:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853707776:0@lo:400:kworker.0 00000100:00100000:3.0:1787602691.181573:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853707136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787602691.181597:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1787602691.181611:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787602691.181633:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853707264 00000100:00100000:2.0:1787602691.181638:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853707264 00000100:00100000:3.0:1787602691.181669:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874436853707136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602691.181674:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787602691.181682:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787602691.181686:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+19:3303:x1874436853707264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787602691.181714:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853707392:0@lo:400:kworker.0 00000100:00100000:2.0:1787602691.181720:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:704a385b-7757-43d8-8441-546b4c8b60c7+19:3303:x1874436853707264:12345-0@lo:400:kworker.0 Request processed in 37us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602691.181728:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787602691.181786:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602691.181787:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853707648 00000100:00100000:2.0:1787602691.181792:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853707648 00000100:00100000:3.0:1787602691.181813:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787602691.181820:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853707520:0@lo:400:kworker.0 00000100:00100000:2.0:1787602691.181823:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853707776 00000100:00100000:2.0:1787602691.181827:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853707776 00000100:00100000:2.0:1787602691.181853:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787602691.181859:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602691.181863:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853707648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602691.181900:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853707648:12345-0@lo:400:kworker.0 Request processed in 40us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602691.181902:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853707392 00000100:00100000:3.0:1787602691.181907:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853707392 00000100:00100000:2.0:1787602691.181912:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787602691.181926:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853707520 00000100:00100000:2.0:1787602691.181930:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853707520 00000100:00100000:2.0:1787602691.181952:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787602691.181958:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853707776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602691.181998:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853707776:12345-0@lo:400:kworker.0 Request processed in 40us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602691.182005:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787602691.182017:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787602691.182023:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853707520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602691.182053:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853707520:12345-0@lo:400:kworker.0 Request processed in 30us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602691.182058:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787602691.182097:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853707776:0@lo:400:kworker.0 00000100:00100000:2.0:1787602691.182108:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853707648:0@lo:400:kworker.0 00000100:00100000:2.0:1787602691.182116:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853707264:0@lo:400:kworker.0 00000100:00100000:2.0:1787602691.182156:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3405fa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1874436853707136:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787602691.182241:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602691.182247:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787602691.182249:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787602691.182380:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787602691.182394:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853707392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602691.182461:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853707520:0@lo:400:kworker.0 00000100:00100000:3.0:1787602691.182618:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853707392:12345-0@lo:400:kworker.0 Request processed in 227us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602691.182626:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787602691.183054:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853707392:0@lo:400:kworker.0 00000100:00100000:1.0:1787602691.685610:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602691.686465:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833789440 00000100:00100000:2.0:1787602691.686481:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833789440 00000100:00100000:2.0:1787602691.686579:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:2.0:1787602691.686590:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+6:14419:x1874436833789440:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602691.686611:0:15127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602691.686632:0:15127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c281e expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.686698:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc63f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.686781:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc63f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.686796:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc63f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.686815:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc646 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.686823:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.686829:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.687616:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703c00/0x3640686da09dc64d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.687628:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703c00/0x3640686da09dc64d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.687637:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703c00/0x3640686da09dc64d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602691.687726:0:15127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787602691.687730:0:15127:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602691.687855:0:15127:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703c00/0x3640686da09dc64d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.687867:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc63f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.687884:0:15127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc63f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.687891:0:15127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc63f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.687897:0:15127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602691.687902:0:15127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc63f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.687909:0:15127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc63f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.687922:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:2.0:1787602691.688322:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602691.688330:0:15127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc63f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.688338:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc63f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.688356:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.688362:0:15127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc646 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.688368:0:15127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc646 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.688373:0:15127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602691.688383:0:15127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc646 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.688389:0:15127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc646 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.688398:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d3504d95400) 00010000:00010000:2.0:1787602691.688401:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602691.688403:0:15127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc646 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.688408:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc646 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.688449:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c281e expref: 8 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.688461:0:15127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703c00/0x3640686da09dc64d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c281e expref: 7 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.688467:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d3504d95a00) 00010000:00010000:2.0:1787602691.688469:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787602691.688471:0:15127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503703c00, rc 0) 00000100:00100000:2.0:1787602691.688699:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+7:14419:x1874436833789440:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 2109us (3104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602691.688707:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:3.0:1787602691.695842:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602691.695912:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833789696 00000100:00100000:0.0:1787602691.695922:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833789696 00000100:00100000:0.0:1787602691.695976:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:0.0:1787602691.695985:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+7:14419:x1874436833789696:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602691.696012:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602691.696033:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc654 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2825 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.696099:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09dc65b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.696122:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09dc65b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.696145:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09dc65b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.696203:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc662 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.696211:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc662 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.696218:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc662 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.696939:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09dc669 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.696949:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09dc669 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.696956:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09dc669 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602691.696966:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787602691.704339:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09dc65b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.704360:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09dc65b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.704369:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09dc65b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.704393:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602691.704398:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09dc65b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.704407:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09dc65b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.704428:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d3504d95a00) 00010000:00010000:0.0:1787602691.704431:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602691.704437:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09dc65b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.704443:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09dc65b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.704458:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc662 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.704464:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc662 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.704469:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc662 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.704474:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a4800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602691.704477:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc662 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.704483:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc662 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.704500:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d350b502100) 00010000:00010000:0.0:1787602691.704503:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602691.704506:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc662 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.704511:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc662 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.704989:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc654 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2825 expref: 10 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.705006:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4600/0x3640686da09dc669 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2825 expref: 9 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.705014:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d350b502f00) 00010000:00010000:0.0:1787602691.705017:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602691.705019:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35110a4600, rc 0) 00000100:00100000:0.0:1787602691.705099:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+9:14419:x1874436833789696:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 9113us (9266us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787602691.705108:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:3.0:1787602691.712720:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602691.714440:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833789824 00000100:00100000:0.0:1787602691.714454:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833789824 00000100:00100000:0.0:1787602691.714524:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:0.0:1787602691.714535:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+9:14419:x1874436833789824:12345-192.168.201.26@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787602691.714674:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+9:14419:x1874436833789824:12345-192.168.201.26@tcp:59:lhsmtool_posix.0 Request processed in 141us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602691.715043:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:2.0:1787602691.768888:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602691.768997:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833789952 00000100:00100000:0.0:1787602691.769008:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833789952 00000100:00100000:0.0:1787602691.769069:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:0.0:1787602691.769081:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+9:14425:x1874436833789952:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602691.769102:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602691.769124:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc677 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c282c expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.769203:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc67e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.769218:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc67e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.769230:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc67e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.769246:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc685 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.769253:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc685 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.769260:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc685 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.769531:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc67e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.769539:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc67e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.769555:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc67e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.769561:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a4e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602691.769566:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc67e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.769573:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc67e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.770599:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:0.0:1787602691.770606:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602691.770612:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc67e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.770621:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc67e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.770639:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc685 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.770645:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc685 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.770652:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc685 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.770658:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a5a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602691.770661:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc685 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.770689:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc685 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.770699:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d350b502100) 00010000:00010000:0.0:1787602691.770702:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602691.770705:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc685 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.770710:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc685 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.770785:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc677 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c282c expref: 10 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.770801:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:0.0:1787602691.770804:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602691.770807:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc677 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c282c expref: 10 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.770817:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35110a4800, rc 0) 00000100:00100000:0.0:1787602691.770947:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+9:14425:x1874436833789952:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1866us (2071us total) trans 0 rc 301/301 00000100:00100000:0.0:1787602691.770956:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:3.0:1787602691.783215:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602691.783402:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833790080 00000100:00100000:1.0:1787602691.783414:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833790080 00000100:00100000:1.0:1787602691.783469:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:1.0:1787602691.783479:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:342ec688-1cf5-4965-b127-eb784a25a838+9:14425:x1874436833790080:12345-192.168.201.26@tcp:700:lfs.0 00000100:00100000:1.0:1787602691.783586:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:342ec688-1cf5-4965-b127-eb784a25a838+9:14425:x1874436833790080:12345-192.168.201.26@tcp:700:lfs.0 Request processed in 95us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602691.783594:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:3.0:1787602691.789540:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602691.789736:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833790336 00000100:00100000:2.0:1787602691.789785:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833790336 00000100:00100000:2.0:1787602691.789849:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:2.0:1787602691.789876:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+9:14425:x1874436833790336:12345-192.168.201.26@tcp:36:lfs.0 00010000:00010000:2.0:1787602691.789937:0:15127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602691.789965:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432e00/0x3640686da09dc5ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c27a7 expref: 9 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.789987:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:2.0:1787602691.789992:0:15127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787602691.790409:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc68c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.790426:0:15127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc5f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2809 expref: 5 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.790435:0:15127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc68c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.790470:0:15127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2809 expref: 5 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.790487:0:15127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc5f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2809 expref: 5 pid: 15127 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602691.790502:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15127:1874436853707904:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602691.791985:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3508732a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787602691.796534:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602691.796561:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15127:1874436853707904:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602691.796607:0:15127:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc68c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602691.796708:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833790464 00000100:00100000:1.0:1787602691.796716:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833790464 00010000:00010000:1.0:1787602691.796804:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc5f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2809 expref: 6 pid: 15127 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602691.796835:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:1.0:1787602691.796844:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01230f64-3401-4225-ba12-2a367927804a+6:2351:x1874436833790464:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602691.796858:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602691.796864:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc5f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2809 expref: 6 pid: 15127 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.796883:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2809 expref: 6 pid: 15127 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.796904:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc5f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2809 expref: 6 pid: 15127 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.796923:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:1.0:1787602691.796930:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc68c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.796941:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc68c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.796950:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc68c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.796976:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602691.797035:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01230f64-3401-4225-ba12-2a367927804a+5:2351:x1874436833790464:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 191us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602691.797042:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00010000:00010000:2.0:1787602691.797474:0:15127:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc68c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.797482:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc68c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.797508:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc693 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.797518:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc693 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.797526:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc693 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602691.802542:0:15127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787602691.802563:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc68c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.802575:0:15127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc68c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.802583:0:15127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc68c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.802589:0:15127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602691.802594:0:15127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc68c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.802602:0:15127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc68c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.802633:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d3529dc7a00) 00010000:00010000:2.0:1787602691.802636:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602691.802642:0:15127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc68c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.802649:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc68c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602691.802671:0:15127:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083202c2c reply state 000000006494282d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc693 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602691.802680:0:15127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787602691.802815:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+10:14425:x1874436833790336:12345-192.168.201.26@tcp:36:lfs.0 Request processed in 12938us (13281us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787602691.802824:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 19 00010000:00010000:0.0:1787602691.807288:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc693 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.807308:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc693 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.807335:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc693 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.807341:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602691.807345:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc693 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.807353:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc693 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.807370:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d3504d95400) 00010000:00010000:0.0:1787602691.807373:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602691.807378:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc693 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.807385:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc693 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602691.903024:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602691.903544:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833790592 00000100:00100000:0.0:1787602691.903556:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833790592 00000100:00100000:0.0:1787602691.903637:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:0.0:1787602691.903649:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+9:14434:x1874436833790592:12345-192.168.201.26@tcp:101:lctl.0 00010000:00010000:0.0:1787602691.903676:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602691.903703:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc69a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2833 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.903849:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09dc6a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.903873:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09dc6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.903884:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09dc6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602691.903961:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787602691.903965:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602691.904010:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09dc6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.904035:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc69a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2833 expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.904059:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4c00/0x3640686da09dc6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2833 expref: 10 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.904068:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502100) 00010000:00010000:0.0:1787602691.904071:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787602691.904074:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35110a4c00, rc 0) 00000100:00100000:0.0:1787602691.904153:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+10:14434:x1874436833790592:12345-192.168.201.26@tcp:101:lctl.0 Request processed in 505us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602691.904160:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:3.0:1787602691.943589:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602691.945788:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833790720 00000100:00100000:0.0:1787602691.945807:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833790720 00000100:00100000:0.0:1787602691.945888:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:0.0:1787602691.945899:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01230f64-3401-4225-ba12-2a367927804a+5:14435:x1874436833790720:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602691.945919:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602691.945953:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc6a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c283a expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.946016:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09dc6af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.946030:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09dc6af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.946040:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09dc6af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602691.946097:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787602691.946100:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602691.946137:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09dc6af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.946163:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc6a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c283a expref: 7 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.946184:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5400/0x3640686da09dc6af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c283a expref: 6 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.946194:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502100) 00010000:00010000:0.0:1787602691.946198:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787602691.946202:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35110a5400, rc 0) 00000100:00100000:0.0:1787602691.946292:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01230f64-3401-4225-ba12-2a367927804a+6:14435:x1874436833790720:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 394us (2718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602691.946300:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:3.0:1787602691.950386:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00010000:00010000:0.0:1787602691.950453:0:16535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787602691.950588:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833790848 00000100:00100000:1.0:1787602691.950603:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833790848 00000100:00100000:1.0:1787602691.950682:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:1.0:1787602691.950695:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01230f64-3401-4225-ba12-2a367927804a+6:14435:x1874436833790848:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787602691.950724:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602691.950779:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc6b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2841 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.950885:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857a00/0x3640686da09dc6bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.950903:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857a00/0x3640686da09dc6bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.950916:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857a00/0x3640686da09dc6bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.950935:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856800/0x3640686da09dc6c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.950943:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856800/0x3640686da09dc6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.950950:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856800/0x3640686da09dc6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.953078:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc6cb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.953103:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc6cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.953116:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc6cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602691.953203:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787602691.953207:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602691.953240:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc6cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.953273:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857a00/0x3640686da09dc6bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.953280:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857a00/0x3640686da09dc6bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.953287:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857a00/0x3640686da09dc6bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.953293:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406857a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602691.953297:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857a00/0x3640686da09dc6bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.953304:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857a00/0x3640686da09dc6bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.954075:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502100) 00010000:00010000:1.0:1787602691.954081:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602691.954086:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857a00/0x3640686da09dc6bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.954093:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857a00/0x3640686da09dc6bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.954110:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856800/0x3640686da09dc6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.954116:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856800/0x3640686da09dc6c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.954122:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856800/0x3640686da09dc6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.954149:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406856800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602691.954152:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856800/0x3640686da09dc6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.954159:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856800/0x3640686da09dc6c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.954169:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d350a016b00) 00010000:00010000:1.0:1787602691.954172:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602691.954175:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856800/0x3640686da09dc6c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.954181:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856800/0x3640686da09dc6c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.954228:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc6b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2841 expref: 8 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.954241:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc6cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2841 expref: 7 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.954248:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d350a016800) 00010000:00010000:1.0:1787602691.954250:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602691.954252:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3406856c00, rc 0) 00000100:00100000:1.0:1787602691.955886:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01230f64-3401-4225-ba12-2a367927804a+7:14435:x1874436833790848:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 5182us (5507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602691.955896:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 22 00000100:00100000:3.0:1787602691.963707:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602691.965717:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833791104 00000100:00100000:0.0:1787602691.965736:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833791104 00000100:00100000:0.0:1787602691.966447:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:0.0:1787602691.966472:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01230f64-3401-4225-ba12-2a367927804a+7:14435:x1874436833791104:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:0.0:1787602691.966504:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602691.966535:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc6d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2848 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602691.966696:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787602691.966911:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc6d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2848 expref: 9 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.966929:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502100) 00010000:00010000:0.0:1787602691.966933:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787602691.966939:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc6d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2848 expref: 9 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602691.966961:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35110a4e00, rc 0) 00000100:00100000:0.0:1787602691.967044:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01230f64-3401-4225-ba12-2a367927804a+8:14435:x1874436833791104:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 576us (3351us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787602691.967051:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 23 00000100:00100000:3.0:1787602691.972049:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602691.972254:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833791360 00000100:00100000:1.0:1787602691.972286:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833791360 00000100:00100000:1.0:1787602691.972374:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 24 00000100:00100000:1.0:1787602691.972388:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01230f64-3401-4225-ba12-2a367927804a+8:14435:x1874436833791360:12345-192.168.201.26@tcp:36:lfs.0 00010000:00010000:1.0:1787602691.972476:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602691.972517:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc6cb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2841 expref: 8 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.972543:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d350a016800) 00010000:00010000:1.0:1787602691.972558:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602691.972590:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc6e0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.972606:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602691.972617:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787602691.972983:0:14423:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000745b874f reply state 00000000fea7de6a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602691.972994:0:14423:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787602691.973011:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787602691.973120:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:01230f64-3401-4225-ba12-2a367927804a+9:14435:x1874436833791360:12345-192.168.201.26@tcp:36:lfs.0 Request processed in 734us (1086us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787602691.973140:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 24 00010000:00010000:3.0:1787602691.976812:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602691.976837:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc6e0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602691.976846:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc6e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602691.976854:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406856e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602691.976860:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc6e0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602691.976869:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc6e0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602691.976894:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d350a016b00) 00010000:00010000:3.0:1787602691.976918:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787602691.976924:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc6e0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602691.976932:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc6e0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602691.978927:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602691.979350:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833791616 00000100:00100000:3.0:1787602691.979365:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833791616 00000100:00100000:3.0:1787602691.979448:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:3.0:1787602691.980158:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01230f64-3401-4225-ba12-2a367927804a+8:14435:x1874436833791616:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:3.0:1787602691.981697:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01230f64-3401-4225-ba12-2a367927804a+9:14435:x1874436833791616:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 1537us (2773us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787602691.981708:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:1.0:1787602691.990395:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602691.990569:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833791872 00000100:00100000:2.0:1787602691.990584:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833791872 00000100:00100000:2.0:1787602691.990661:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:2.0:1787602691.990674:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01230f64-3401-4225-ba12-2a367927804a+9:14435:x1874436833791872:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787602691.990707:0:15127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602691.990776:0:15127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc6e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c284f expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.990883:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc6ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.990902:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc6ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.990935:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc6ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.990954:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc6f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.990961:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.990968:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602691.991156:0:15127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787602691.991607:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc6ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.991617:0:15127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc6ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.991624:0:15127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc6ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.991632:0:15127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602691.991636:0:15127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc6ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.991645:0:15127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc6ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.991661:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502100) 00010000:00010000:2.0:1787602691.991665:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602691.991680:0:15127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc6ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.991688:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc6ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.991706:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.991712:0:15127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc6f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.991718:0:15127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.991724:0:15127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602691.991727:0:15127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.991733:0:15127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc6f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.998609:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d3504d95f00) 00010000:00010000:2.0:1787602691.998623:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602691.998634:0:15127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc6f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.998649:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc6f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.998991:0:15127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc6e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c284f expref: 11 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.999038:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502100) 00010000:00010000:2.0:1787602691.999041:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787602691.999047:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc6e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c284f expref: 11 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602691.999058:0:15127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702000, rc 0) 00000100:00100000:2.0:1787602691.999223:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:01230f64-3401-4225-ba12-2a367927804a+10:14435:x1874436833791872:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 8543us (8834us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787602691.999235:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 25 00000100:00100000:1.0:1787602692.007908:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602692.008012:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833792000 00000100:00100000:3.0:1787602692.008027:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833792000 00000100:00100000:3.0:1787602692.008203:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00100000:3.0:1787602692.008218:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01230f64-3401-4225-ba12-2a367927804a+10:14435:x1874436833792000:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602692.008251:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602692.008282:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc703 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2856 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.008396:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dc70a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.008413:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dc70a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.008427:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dc70a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602692.008524:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787602692.008528:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602692.008557:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dc70a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.008592:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc703 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2856 expref: 12 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.008611:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dc70a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2856 expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.008621:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:3.0:1787602692.008624:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787602692.008629:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433a00, rc 0) 00000100:00100000:3.0:1787602692.008718:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:01230f64-3401-4225-ba12-2a367927804a+11:14435:x1874436833792000:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 504us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602692.008726:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 26 00000100:00080000:1.0:1787602692.008945:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602692.013174:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602692.013353:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833792128 00000100:00100000:2.0:1787602692.013370:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833792128 00000100:00100000:2.0:1787602692.013445:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:2.0:1787602692.013467:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:01230f64-3401-4225-ba12-2a367927804a+11:14435:x1874436833792128:12345-192.168.201.26@tcp:37:lfs.0 00000100:00100000:1.0:1787602692.019690:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:01230f64-3401-4225-ba12-2a367927804a+11:14435:x1874436833792128:12345-192.168.201.26@tcp:37:lfs.0 Request processed in 6212us (6515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602692.019707:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 3 00000100:00100000:1.0:1787602692.023986:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602692.024081:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833792384 00000100:00100000:3.0:1787602692.024094:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833792384 00000100:00100000:3.0:1787602692.024177:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:3.0:1787602692.024190:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3404371050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01230f64-3401-4225-ba12-2a367927804a+11:14435:x1874436833792384:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:3.0:1787602692.024592:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3404371050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:01230f64-3401-4225-ba12-2a367927804a+12:14435:x1874436833792384:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 403us (621us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787602692.024601:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 4 00000100:00100000:3.0:1787602692.101900:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602692.102158:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833792512 00000100:00100000:1.0:1787602692.102173:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833792512 00000100:00100000:1.0:1787602692.102292:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 27 00000100:00100000:1.0:1787602692.102305:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+10:14441:x1874436833792512:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:1.0:1787602692.102337:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602692.102372:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857a00/0x3640686da09dc711 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c285d expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.102594:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc718 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.102613:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.102631:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.102648:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc71f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.102655:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc71f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.102662:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc71f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.102912:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856800/0x3640686da09dc726 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.102940:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856800/0x3640686da09dc726 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.102949:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856800/0x3640686da09dc726 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602692.103001:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787602692.103005:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787602692.103056:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856800/0x3640686da09dc726 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103071:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103079:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc718 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103086:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc718 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103093:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406856e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602692.103098:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc718 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103107:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc718 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103154:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502100) 00010000:00010000:1.0:1787602692.103159:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602692.103165:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc718 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103184:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103202:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc71f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103209:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc71f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103228:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc71f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103235:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406856c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602692.103239:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc71f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103246:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc71f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103254:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d350a016800) 00010000:00010000:1.0:1787602692.103258:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602692.103261:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc71f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103268:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc71f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103312:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857a00/0x3640686da09dc711 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c285d expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103343:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856800/0x3640686da09dc726 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c285d expref: 11 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.103352:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:1.0:1787602692.103355:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787602692.103358:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3406856800, rc 0) 00000100:00080000:2.0:1787602692.103564:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787602692.104635:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+11:14441:x1874436833792512:12345-192.168.201.26@tcp:101:bash.0 Request processed in 2320us (2738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602692.104647:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 27 00000100:00100000:0.0:1787602692.111722:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602692.112079:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833792768 00000100:00100000:2.0:1787602692.112093:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833792768 00000100:00100000:2.0:1787602692.112186:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 28 00000100:00100000:2.0:1787602692.112206:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+11:14441:x1874436833792768:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787602692.112235:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602692.112265:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc72d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2864 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.112455:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc734 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.112475:0:14421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dc70a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2856 expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.112504:0:14421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc734 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.112553:0:14421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dc70a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2856 expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.112569:0:14421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dc70a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2856 expref: 11 pid: 14422 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602692.112588:0:14421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d35378f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1874436853708032:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602692.112723:0:14421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d3508732a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787602692.118411:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602692.118725:0:16536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833792896 00000100:00100000:1.0:1787602692.118740:0:16536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833792896 00010000:00010000:1.0:1787602692.118845:0:16536:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dc70a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2856 expref: 12 pid: 14422 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602692.118893:0:16536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:1.0:1787602692.118905:0:16536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:01230f64-3401-4225-ba12-2a367927804a+12:2352:x1874436833792896:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787602692.118927:0:16536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602692.118935:0:16536:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dc70a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2856 expref: 12 pid: 14422 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.118951:0:16536:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dc70a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2856 expref: 12 pid: 14422 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.118981:0:16536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:1.0:1787602692.118988:0:16536:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc734 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.119010:0:16536:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc734 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.119019:0:16536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc734 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.119045:0:16536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787602692.119106:0:16536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:01230f64-3401-4225-ba12-2a367927804a+12:2352:x1874436833792896:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 204us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602692.119115:0:16536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00010000:00010000:2.0:1787602692.119966:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433a00/0x3640686da09dc70a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2856 expref: 11 pid: 14422 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602692.119990:0:14421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d35378f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1874436853708032:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602692.120018:0:14421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc734 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.120029:0:14421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc734 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.120035:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc734 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.122384:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc73b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.123225:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc73b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.123258:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc73b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.125145:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc742 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.125163:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc742 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.125174:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc742 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602692.125186:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787602692.125216:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc734 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.125224:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc734 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.125232:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc734 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.125238:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702400 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602692.125243:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc734 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.125251:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc734 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.125264:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:2.0:1787602692.125269:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602692.125282:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc734 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.125289:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc734 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602692.125304:0:14421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af6bfc9c reply state 000000005895c84d transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc73b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602692.125313:0:14421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787602692.125352:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702000/0x3640686da09dc72d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2864 expref: 14 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.125367:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc742 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2864 expref: 13 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.125375:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:2.0:1787602692.125377:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787602692.125379:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702a00, rc 0) 00000100:00100000:2.0:1787602692.128783:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+14:14441:x1874436833792768:12345-192.168.201.26@tcp:101:bash.0 Request processed in 16576us (17067us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787602692.128797:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 28 00010000:00010000:0.0:1787602692.137043:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc73b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602692.137062:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc73b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602692.137070:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc73b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602692.137111:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602692.137116:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc73b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602692.137133:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc73b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602692.137155:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d3504d95f00) 00010000:00010000:0.0:1787602692.137157:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602692.137162:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc73b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602692.137168:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703a00/0x3640686da09dc73b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602692.159075:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602692.162567:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833793024 00000100:00100000:2.0:1787602692.162589:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833793024 00000100:00100000:3.0:1787602692.167086:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 29 00000100:00100000:3.0:1787602692.167105:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+13:14441:x1874436833793024:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:3.0:1787602692.167151:0:15127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602692.167181:0:15127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dc750 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c286b expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.167292:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc757 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.167309:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc757 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.167322:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc757 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602692.167370:0:15127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787602692.167374:0:15127:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787602692.167399:0:15127:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc757 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.167411:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc757 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.167439:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dc750 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c286b expref: 15 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.168313:0:15127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc757 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c286b expref: 14 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.168326:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:3.0:1787602692.168350:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787602692.168355:0:15127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433200, rc 0) 00000100:00100000:3.0:1787602692.168443:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+14:14441:x1874436833793024:12345-192.168.201.26@tcp:101:bash.0 Request processed in 1342us (9383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602692.172308:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 29 00000100:00100000:3.0:1787602692.172464:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602692.172510:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833793280 00000100:00100000:3.0:1787602692.172522:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833793280 00000100:00100000:3.0:1787602692.172580:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 5 00000100:00100000:3.0:1787602692.172592:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+14:14441:x1874436833793280:12345-192.168.201.26@tcp:35:bash.0 00000100:00100000:3.0:1787602692.173858:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+15:14441:x1874436833793280:12345-192.168.201.26@tcp:35:bash.0 Request processed in 1260us (1388us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787602692.173870:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 5 00000001:00080000:0.0:1787602692.286253:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:0.0:1787602692.286278:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934593 is committed 00000001:00080000:0.0:1787602692.286285:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:0.0:1787602692.286292:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934600 is committed 00000001:00080000:0.0:1787602692.286299:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1787602692.286306:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934601 is committed 00000001:00080000:0.0:1787602692.286313:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1787602692.318896:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602692.319105:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833793536 00000100:00100000:3.0:1787602692.319148:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833793536 00000100:00100000:3.0:1787602692.319242:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 30 00000100:00100000:3.0:1787602692.319254:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+11:14451:x1874436833793536:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:3.0:1787602692.319287:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602692.319321:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc75e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2872 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787602692.319788:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787602692.320056:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc75e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2872 expref: 13 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.320077:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502100) 00010000:00010000:3.0:1787602692.320081:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787602692.320098:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc75e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2872 expref: 13 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.320114:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433e00, rc 0) 00000100:00100000:3.0:1787602692.320225:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+12:14451:x1874436833793536:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 973us (1344us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787602692.320234:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 30 00000100:00100000:3.0:1787602692.335590:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602692.335809:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833793792 00000100:00100000:0.0:1787602692.335824:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833793792 00000100:00100000:0.0:1787602692.335905:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:0.0:1787602692.335919:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+12:14451:x1874436833793792:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:0.0:1787602692.336700:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+13:14451:x1874436833793792:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 779us (1123us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787602692.336720:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 6 00000100:00100000:0.0:1787602692.392269:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602692.392400:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833794048 00000100:00100000:1.0:1787602692.392414:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833794048 00000100:00100000:1.0:1787602692.392504:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00100000:1.0:1787602692.392516:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+13:14454:x1874436833794048:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:1.0:1787602692.392549:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602692.392577:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc76c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2879 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.392719:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc773 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.392737:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc773 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.392807:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc773 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602692.392821:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787602692.392987:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc76c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2879 expref: 16 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.393029:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc773 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2879 expref: 15 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.393039:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:1.0:1787602692.393042:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602692.393045:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3406856e00, rc 0) 00000100:00100000:1.0:1787602692.393135:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+15:14454:x1874436833794048:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 620us (882us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787602692.393143:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00100000:1.0:1787602692.398497:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602692.398693:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833794176 00000100:00100000:3.0:1787602692.398707:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833794176 00000100:00100000:3.0:1787602692.398811:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:3.0:1787602692.398825:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:342ec688-1cf5-4965-b127-eb784a25a838+15:2351:x1874436833794176:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602692.398844:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602692.398875:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856e00/0x3640686da09dc773 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2879 expref: 15 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.398900:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:3.0:1787602692.398905:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602692.398979:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:342ec688-1cf5-4965-b127-eb784a25a838+14:2351:x1874436833794176:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 156us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602692.398987:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:3.0:1787602692.399885:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602692.399985:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833794304 00000100:00100000:3.0:1787602692.399994:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833794304 00000100:00100000:3.0:1787602692.400039:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00100000:3.0:1787602692.400048:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+14:14454:x1874436833794304:12345-192.168.201.26@tcp:54:lfs.0 00010000:00010000:3.0:1787602692.400140:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dc781 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.400176:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dc781 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.400196:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dc781 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.400241:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dc781 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.400249:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dc781 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.400257:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dc781 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.400264:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602692.400270:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dc781 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.400279:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dc781 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.400290:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:3.0:1787602692.400294:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787602692.400299:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dc781 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.400307:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dc781 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602692.400368:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+14:14454:x1874436833794304:12345-192.168.201.26@tcp:54:lfs.0 Request processed in 321us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602692.400382:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 32 00000100:00100000:3.0:1787602692.403082:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602692.403222:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833794560 00000100:00100000:0.0:1787602692.403235:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833794560 00000100:00100000:0.0:1787602692.403302:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:0.0:1787602692.403315:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+14:14454:x1874436833794560:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:0.0:1787602692.403825:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+15:14454:x1874436833794560:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 511us (756us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787602692.403835:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 7 00000100:00100000:1.0:1787602692.637978:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602692.638154:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833794816 00000100:00100000:0.0:1787602692.638167:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833794816 00000100:00100000:0.0:1787602692.638264:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:0.0:1787602692.638277:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+15:14485:x1874436833794816:12345-192.168.201.26@tcp:101:cat.0 00010000:00010000:0.0:1787602692.638309:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602692.638337:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc788 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2880 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602692.638598:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc78f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602692.638616:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc78f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602692.638630:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc78f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602692.638643:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787602692.638988:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc788 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2880 expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602692.639016:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc78f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2880 expref: 17 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602692.639028:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:0.0:1787602692.639031:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787602692.639035:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35110a5a00, rc 0) 00000100:00100000:0.0:1787602692.639268:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+17:14485:x1874436833794816:12345-192.168.201.26@tcp:101:cat.0 Request processed in 991us (1304us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787602692.639277:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 33 00000100:00100000:1.0:1787602692.649946:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602692.650004:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602692.650178:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833795072 00000100:00100000:0.0:1787602692.650203:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833795072 00000100:00100000:0.0:1787602692.650277:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:0.0:1787602692.650289:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+17:14485:x1874436833795072:12345-192.168.201.26@tcp:35:cat.0 00000100:00100000:0.0:1787602692.650831:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+18:14485:x1874436833795072:12345-192.168.201.26@tcp:35:cat.0 Request processed in 541us (897us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787602692.650840:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 8 00000100:00100000:3.0:1787602692.651629:0:16536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833795200 00000100:00100000:3.0:1787602692.651639:0:16536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833795200 00000100:00100000:3.0:1787602692.651701:0:16536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 1 00000100:00100000:3.0:1787602692.651712:0:16536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:342ec688-1cf5-4965-b127-eb784a25a838+18:2351:x1874436833795200:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602692.651727:0:16536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602692.651798:0:16536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc78f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2880 expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.651826:0:16536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:3.0:1787602692.651832:0:16536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602692.651881:0:16536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:342ec688-1cf5-4965-b127-eb784a25a838+17:2351:x1874436833795200:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 171us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602692.651889:0:16536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 1 00000040:00080000:0.0:1787602692.660582:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787602692.720790:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853708160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787602692.720908:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602692.721140:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853708160 00000100:00100000:3.0:1787602692.721151:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853708160 00000100:00100000:3.0:1787602692.721225:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787602692.721236:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d35378f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853708160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602692.721282:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602692.721351:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d35378f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874436853708160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602692.721359:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787602692.721819:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853708160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787602692.797586:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602692.801691:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833795456 00000100:00100000:3.0:1787602692.801713:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833795456 00000100:00100000:2.0:1787602692.806219:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 34 00000100:00100000:2.0:1787602692.806248:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3405fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+17:14491:x1874436833795456:12345-192.168.201.26@tcp:101:dd.0 00010000:00010000:2.0:1787602692.806307:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602692.806337:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc79d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2887 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.806957:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc7a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.806979:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.806994:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602692.807009:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787602692.807220:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc79d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2887 expref: 20 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.807257:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc7a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2887 expref: 19 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.807269:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:2.0:1787602692.807274:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602692.807279:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702800, rc 0) 00000100:00100000:2.0:1787602692.807379:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3405fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+19:14491:x1874436833795456:12345-192.168.201.26@tcp:101:dd.0 Request processed in 1143us (9808us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787602692.807389:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 34 00000100:00100000:0.0:1787602692.812736:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602692.812852:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833795712 00000100:00100000:2.0:1787602692.812880:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833795712 00000100:00100000:2.0:1787602692.812970:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 35 00000100:00100000:2.0:1787602692.813006:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+19:14491:x1874436833795712:12345-192.168.201.26@tcp:36:dd.0 00010000:00010000:2.0:1787602692.813107:0:15127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787602692.813162:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc7a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2887 expref: 19 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.813195:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433200/0x3640686da09dc757 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c286b expref: 18 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.813208:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:2.0:1787602692.813214:0:15127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787602692.814617:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc7b2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.814644:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602692.814656:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787602692.814739:0:15127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787602692.814985:0:15127:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000598a3c65 reply state 00000000f353a5cf transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602692.814996:0:15127:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787602692.815203:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+20:14491:x1874436833795712:12345-192.168.201.26@tcp:36:dd.0 Request processed in 2195us (2479us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787602692.815214:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 35 00000020:00080000:2.0:1787602692.815220:0:15127:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787602692.822500:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.822557:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc7b2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.822566:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc7b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.822574:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602692.822579:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc7b2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.822588:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc7b2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.822610:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:3.0:1787602692.822614:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602692.822620:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc7b2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602692.822626:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702e00/0x3640686da09dc7b2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602692.976298:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602692.984944:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602692.985407:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833795968 00000100:00100000:3.0:1787602692.985422:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833795968 00000100:00100000:3.0:1787602692.985510:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:3.0:1787602692.985524:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+19:14491:x1874436833795968:12345-192.168.201.26@tcp:35:dd.0 00000100:00100000:3.0:1787602692.985965:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+20:14491:x1874436833795968:12345-192.168.201.26@tcp:35:dd.0 Request processed in 442us (1035us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1787602692.985975:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 9 00000100:00100000:1.0:1787602693.217718:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602693.217945:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833796096 00000100:00100000:3.0:1787602693.217981:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833796096 00000100:00100000:3.0:1787602693.218058:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:3.0:1787602693.218071:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+20:14505:x1874436833796096:12345-192.168.201.26@tcp:101:stat.0 00010000:00010000:3.0:1787602693.218114:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602693.218152:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dc7b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c288e expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.218354:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc7c0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.218373:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.218388:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.218400:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432800/0x3640686da09dc7c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.218405:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432800/0x3640686da09dc7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.218409:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432800/0x3640686da09dc7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219391:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc7ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219424:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc7ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219435:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc7ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602693.219500:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787602693.219506:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602693.219559:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc7ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219573:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc7ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219583:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219590:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc7c0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219596:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219602:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d433e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602693.219608:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219614:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc7c0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219630:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:2.0:1787602693.219639:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602693.219645:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc7c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219651:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433e00/0x3640686da09dc7c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219669:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432800/0x3640686da09dc7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219674:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432800/0x3640686da09dc7c7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219680:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432800/0x3640686da09dc7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219686:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602693.219689:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432800/0x3640686da09dc7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219695:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432800/0x3640686da09dc7c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219703:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d3529dc7000) 00010000:00010000:2.0:1787602693.219706:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602693.219708:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432800/0x3640686da09dc7c7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219714:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432800/0x3640686da09dc7c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219829:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433000/0x3640686da09dc7b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c288e expref: 22 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219859:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc7ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c288e expref: 21 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.219867:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:2.0:1787602693.219870:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602693.219873:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702800, rc 0) 00000100:00100000:2.0:1787602693.219972:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+21:14505:x1874436833796096:12345-192.168.201.26@tcp:101:stat.0 Request processed in 1902us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602693.219983:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 36 00000100:00100000:0.0:1787602693.302160:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602693.304869:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833796352 00000100:00100000:1.0:1787602693.304891:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833796352 00000100:00100000:1.0:1787602693.305078:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 37 00000100:00100000:1.0:1787602693.305092:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+21:14511:x1874436833796352:12345-192.168.201.26@tcp:36:truncate.0 00010000:00010000:1.0:1787602693.305197:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602693.305235:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc7ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c288e expref: 21 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602693.305263:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:1.0:1787602693.305288:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602693.305588:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc7d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602693.305606:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc7d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602693.305619:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc7d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787602693.305684:0:14423:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1787602693.305713:0:14423:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c939c40 reply state 00000000c8fff630 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc7d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602693.305724:0:14423:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787602693.305965:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+23:14511:x1874436833796352:12345-192.168.201.26@tcp:36:truncate.0 Request processed in 874us (3836us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787602693.305974:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 37 00000020:00080000:1.0:1787602693.305979:0:14423:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787602693.308998:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc7d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.309022:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc7d5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.309031:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc7d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.309054:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406857000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602693.309060:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc7d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.309069:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc7d5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.309092:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:3.0:1787602693.309095:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602693.309111:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc7d5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.309119:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc7d5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602693.569342:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602693.572373:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833796480 00000100:00100000:2.0:1787602693.572396:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833796480 00000100:00100000:2.0:1787602693.573136:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 38 00000100:00100000:2.0:1787602693.573151:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+22:14525:x1874436833796480:12345-192.168.201.26@tcp:101:stat.0 00010000:00010000:2.0:1787602693.573251:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602693.573282:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc7dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c2895 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.573368:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc7e3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.573385:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc7e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.573398:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc7e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.573419:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc7ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.574126:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc7ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.574137:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc7ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575336:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc7f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575356:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575368:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602693.575437:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1787602693.575443:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602693.575471:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575487:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575497:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc7e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575505:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc7e3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575512:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc7e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575532:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602693.575539:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc7e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575692:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc7e3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575709:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:2.0:1787602693.575712:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602693.575717:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc7e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575723:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc7e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575740:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc7ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575796:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc7ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575803:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc7ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575807:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702600 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602693.575809:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc7ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575815:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc7ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575834:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d3504d95c00) 00010000:00010000:2.0:1787602693.575836:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602693.575839:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc7ea lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575844:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc7ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575893:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc7dc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2895 expref: 24 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.575908:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc7f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2895 expref: 23 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.576084:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:2.0:1787602693.576087:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602693.576089:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702200, rc 0) 00000100:00100000:2.0:1787602693.576206:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+23:14525:x1874436833796480:12345-192.168.201.26@tcp:101:stat.0 Request processed in 3057us (6877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602693.576216:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 38 00000100:00100000:0.0:1787602693.725278:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602693.725664:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833796736 00000100:00100000:2.0:1787602693.725678:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833796736 00000100:00100000:2.0:1787602693.725788:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:2.0:1787602693.725800:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+23:14535:x1874436833796736:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787602693.725826:0:15127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602693.725852:0:15127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc7f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c289c expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602693.726779:0:15127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787602693.727008:0:15127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc7f8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c289c expref: 25 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.727027:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502100) 00010000:00010000:2.0:1787602693.727030:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787602693.727036:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc7f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c289c expref: 25 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.727050:0:15127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702400, rc 0) 00000100:00100000:2.0:1787602693.727225:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+24:14535:x1874436833796736:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 1420us (1954us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1787602693.727234:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 39 00000100:00100000:3.0:1787602693.737628:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602693.737807:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833796992 00000100:00100000:0.0:1787602693.737822:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833796992 00000100:00100000:0.0:1787602693.737915:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:0.0:1787602693.737926:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3404371850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+24:14535:x1874436833796992:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:0.0:1787602693.739652:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3404371850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+25:14535:x1874436833796992:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 1715us (2027us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787602693.739665:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 10 00000100:00100000:0.0:1787602693.821236:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602693.821358:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833797248 00000100:00100000:2.0:1787602693.821372:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833797248 00000100:00100000:2.0:1787602693.821462:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:2.0:1787602693.821475:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+25:14541:x1874436833797248:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787602693.821508:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602693.821537:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc806 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c28a3 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.821674:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.821689:0:14421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc742 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2864 expref: 26 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.821720:0:14421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc7f1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2895 expref: 26 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.821729:0:14421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.821809:0:14421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc7f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2895 expref: 26 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.821825:0:14421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc7f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2895 expref: 26 pid: 14422 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602693.821840:0:14421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1874436853708288:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602693.822087:0:14421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc742 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2864 expref: 26 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.822107:0:14421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc742 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2864 expref: 26 pid: 14421 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602693.822116:0:14421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1874436853708416:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602693.822142:0:14421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350316d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787602693.829449:0:14421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1874436853708288:192.168.201.26@tcp:104: 00000100:00100000:3.0:1787602693.831346:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602693.831406:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602693.831910:0:14421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14421:1874436853708416:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602693.831951:0:14421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602693.832551:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833797376 00000100:00100000:0.0:1787602693.832563:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833797376 00010000:00010000:0.0:1787602693.832617:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc7f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2895 expref: 27 pid: 14422 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602693.832664:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833797504 00000100:00100000:0.0:1787602693.832669:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833797504 00010000:00010000:0.0:1787602693.832685:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc742 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2864 expref: 28 pid: 14421 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602693.832716:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:0.0:1787602693.832728:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3504d86850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:342ec688-1cf5-4965-b127-eb784a25a838+28:2352:x1874436833797376:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602693.832785:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602693.832793:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc7f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2895 expref: 28 pid: 14422 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.832807:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc7f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2895 expref: 28 pid: 14422 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.832835:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc7f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2895 expref: 28 pid: 14422 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.832872:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:0.0:1787602693.832879:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.832890:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.832897:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602693.833056:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3504d86850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:342ec688-1cf5-4965-b127-eb784a25a838+27:2352:x1874436833797376:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 329us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602693.833063:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:0.0:1787602693.833148:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:0.0:1787602693.833155:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:342ec688-1cf5-4965-b127-eb784a25a838+26:2352:x1874436833797504:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602693.833166:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602693.833171:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc742 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2864 expref: 26 pid: 14421 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.833181:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc742 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2864 expref: 26 pid: 14421 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.833193:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc742 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c2864 expref: 26 pid: 14421 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.833203:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:0.0:1787602693.833207:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.833230:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.833238:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.833264:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787602693.833513:0:14421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.833524:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602693.833560:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1787602693.833811:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc806 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28a3 expref: 27 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.833833:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28a3 expref: 26 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.833843:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:2.0:1787602693.833846:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787602693.833849:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702600, rc 0) 00000100:00100000:0.0:1787602693.834560:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:342ec688-1cf5-4965-b127-eb784a25a838+26:2352:x1874436833797504:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 1398us (3147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602693.834572:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:2.0:1787602693.834991:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+25:14541:x1874436833797248:12345-192.168.201.26@tcp:101:bash.0 Request processed in 13516us (13774us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1787602693.835000:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 40 00000100:00100000:1.0:1787602693.844525:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602693.846737:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833797760 00000100:00100000:0.0:1787602693.846777:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833797760 00000100:00100000:0.0:1787602693.846873:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 41 00000100:00100000:0.0:1787602693.846886:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+25:14541:x1874436833797760:12345-192.168.201.26@tcp:36:bash.0 00010000:00010000:0.0:1787602693.847279:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc81b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.847302:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc81b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.847317:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc81b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787602693.847966:0:14423:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1787602693.848009:0:14423:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fa79221 reply state 0000000013c5ea3e transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc81b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602693.848022:0:14423:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787602693.848215:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+28:14541:x1874436833797760:12345-192.168.201.26@tcp:36:bash.0 Request processed in 1329us (4487us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1787602693.848241:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 41 00000020:00080000:0.0:1787602693.848251:0:14423:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787602693.853165:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc81b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602693.853189:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc81b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602693.853198:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc81b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602693.853204:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a4800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602693.853210:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc81b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602693.853240:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc81b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602693.853261:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:1.0:1787602693.853265:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602693.853270:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc81b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602693.853275:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc81b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602693.861528:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602693.862218:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833797888 00000100:00100000:3.0:1787602693.862234:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833797888 00000100:00100000:3.0:1787602693.862314:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 42 00000100:00100000:3.0:1787602693.862326:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+27:14541:x1874436833797888:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:3.0:1787602693.862356:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787602693.862383:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433400/0x3640686da09dc822 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c28aa expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.862472:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433400/0x3640686da09dc822 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28aa expref: 28 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.862515:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433400/0x3640686da09dc822 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28aa expref: 28 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.862540:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:3.0:1787602693.862544:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602693.862548:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d353d433400, rc 0) 00000100:00100000:3.0:1787602693.862623:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+28:14541:x1874436833797888:12345-192.168.201.26@tcp:101:bash.0 Request processed in 300us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602693.862631:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 42 00000100:00100000:3.0:1787602693.885544:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602693.885678:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833798016 00000100:00100000:2.0:1787602693.885693:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833798016 00000100:00100000:2.0:1787602693.885818:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:2.0:1787602693.885830:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+28:14541:x1874436833798016:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:2.0:1787602693.885859:0:15127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602693.885888:0:15127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc829 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c28b1 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.886029:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc830 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.886046:0:15127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28a3 expref: 29 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.886058:0:15127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc830 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.886116:0:15127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28a3 expref: 29 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.886133:0:15127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28a3 expref: 29 pid: 14421 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602693.886151:0:15127:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15127:1874436853708544:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602693.886269:0:15127:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350316d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602693.890254:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602693.890861:0:15127:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d3534f7dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15127:1874436853708544:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602693.890904:0:15127:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc830 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602693.891120:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833798144 00000100:00100000:3.0:1787602693.891131:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833798144 00010000:00010000:3.0:1787602693.891196:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28a3 expref: 30 pid: 14421 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602693.891255:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:3.0:1787602693.891267:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:342ec688-1cf5-4965-b127-eb784a25a838+30:2351:x1874436833798144:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787602693.891287:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787602693.891296:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28a3 expref: 30 pid: 14421 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.891310:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28a3 expref: 30 pid: 14421 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.891337:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702600/0x3640686da09dc80d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28a3 expref: 30 pid: 14421 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.891381:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:3.0:1787602693.891387:0:14408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc830 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.891397:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc830 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.891406:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc830 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.891671:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602693.892063:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:342ec688-1cf5-4965-b127-eb784a25a838+29:2351:x1874436833798144:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 795us (1836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602693.892072:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00010000:00010000:2.0:1787602693.892395:0:15127:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc830 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.892405:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc830 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602693.892485:0:15127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787602693.892507:0:15127:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602693.892672:0:15127:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc830 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.892716:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702400/0x3640686da09dc829 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28b1 expref: 29 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.892735:0:15127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc830 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28b1 expref: 28 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.892777:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:2.0:1787602693.892781:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787602693.892785:0:15127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503703800, rc 0) 00000100:00100000:2.0:1787602693.892836:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+28:14541:x1874436833798016:12345-192.168.201.26@tcp:101:bash.0 Request processed in 7008us (7308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602693.892844:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 43 00000100:00100000:1.0:1787602693.921046:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602693.921182:0:16536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833798400 00000100:00100000:3.0:1787602693.921196:0:16536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833798400 00000100:00100000:3.0:1787602693.921298:0:16536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:3.0:1787602693.921311:0:16536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:342ec688-1cf5-4965-b127-eb784a25a838+28:14541:x1874436833798400:12345-192.168.201.26@tcp:103:bash.0 00010000:00010000:3.0:1787602693.921331:0:16536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787602693.921367:0:16536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc830 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28b1 expref: 28 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.921398:0:16536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d433400/0x3640686da09dc822 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28aa expref: 27 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602693.921410:0:16536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95700) 00010000:00010000:3.0:1787602693.921448:0:16536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787602693.923571:0:16536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:342ec688-1cf5-4965-b127-eb784a25a838+26:14541:x1874436833798400:12345-192.168.201.26@tcp:103:bash.0 Request processed in 2246us (2522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602693.923587:0:16536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 2 00000100:00100000:0.0:1787602693.930183:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602693.930723:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833798528 00000100:00100000:2.0:1787602693.930738:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833798528 00000100:00100000:2.0:1787602693.930860:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:2.0:1787602693.930874:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+26:14541:x1874436833798528:12345-192.168.201.26@tcp:58:bash.0 00010000:00010000:2.0:1787602693.931014:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09dc837 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.931037:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09dc837 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602693.931052:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09dc837 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787602693.936229:0:14422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787602693.937797:0:14422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787602693.937916:0:14422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787602693.938119:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+26:14541:x1874436833798528:12345-192.168.201.26@tcp:58:bash.0 Request processed in 7239us (7943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602693.938133:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 44 00000100:00100000:2.0:1787602693.946885:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602693.947007:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833798656 00000100:00100000:0.0:1787602693.947021:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833798656 00000100:00100000:0.0:1787602693.947114:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 45 00000100:00100000:0.0:1787602693.947129:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+26:14541:x1874436833798656:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:0.0:1787602693.947160:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602693.947191:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc83e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c28b8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.947280:0:14423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09dc837 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.947293:0:14423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc83e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28b8 expref: 27 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.947318:0:14423:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09dc837 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.947334:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc83e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28b8 expref: 27 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.947350:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95c00) 00010000:00010000:0.0:1787602693.947354:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787602693.947358:0:14423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc83e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28b8 expref: 27 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602693.947389:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35110a5a00, rc 0) 00000100:00100000:0.0:1787602693.947475:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+27:14541:x1874436833798656:12345-192.168.201.26@tcp:101:bash.0 Request processed in 349us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602693.947483:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 45 00010000:00010000:2.0:1787602693.996973:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787602694.702403:0:14454:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787602694.702418:0:14454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787602694.702463:0:14454:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787602694.702470:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787602694.702645:0:14454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14454:1874436853708672:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787602694.702839:0:14454:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350bb77b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787602694.709138:0:14454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14454:1874436853708672:192.168.201.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787602694.711447:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602694.717274:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833798784 00000100:00100000:0.0:1787602694.717298:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833798784 00000100:00100000:0.0:1787602694.717412:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:0.0:1787602694.717431:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:342ec688-1cf5-4965-b127-eb784a25a838+27:14542:x1874436833798784:12345-192.168.201.26@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787602694.717561:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:342ec688-1cf5-4965-b127-eb784a25a838+27:14542:x1874436833798784:12345-192.168.201.26@tcp:900:lhsmtool_posix.0 Request processed in 136us (6127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602694.717570:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00080000:2.0:1787602694.717901:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787602694.723799:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602694.724005:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833798912 00000100:00100000:0.0:1787602694.724019:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833798912 00000100:00100000:0.0:1787602694.724099:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:0.0:1787602694.724112:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+27:14542:x1874436833798912:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787602694.724155:0:14421:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787602694.724292:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+27:14542:x1874436833798912:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 183us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602694.724317:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 46 00000100:00100000:1.0:1787602694.730020:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602694.730928:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833799040 00000100:00100000:0.0:1787602694.730946:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833799040 00000100:00100000:0.0:1787602694.731107:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:0.0:1787602694.731121:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+27:14542:x1874436833799040:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787602694.731651:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc845 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.731676:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc845 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.731694:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc845 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.744161:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc84c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.744200:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc84c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.744216:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc84c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.744255:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc853 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.744264:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc853 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746002:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc853 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787602694.746092:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787602694.746098:0:14423:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787602694.746115:0:14423:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc853 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746130:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc845 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746136:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc845 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746144:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc845 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746150:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a4800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602694.746154:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc845 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746162:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc845 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746177:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d350b502f00) 00010000:00010000:0.0:1787602694.746180:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602694.746185:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc845 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746190:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4800/0x3640686da09dc845 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746209:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc84c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746226:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc84c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746231:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc84c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746236:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a4e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602694.746239:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc84c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746245:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc84c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746253:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8d350b502300) 00010000:00010000:0.0:1787602694.746255:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602694.746258:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc84c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746262:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc84c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746292:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc853 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746298:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc853 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746303:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc853 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746307:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:0.0:1787602694.746315:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc853 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746320:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc853 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746328:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95c00) 00010000:00010000:0.0:1787602694.746330:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787602694.746332:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc853 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.746338:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc853 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602694.746446:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+27:14542:x1874436833799040:12345-192.168.201.26@tcp:34:lhsmtool_posix.0 Request processed in 15324us (16438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602694.746455:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 47 00000100:00100000:3.0:1787602694.749500:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602694.755610:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833799296 00000100:00100000:0.0:1787602694.755629:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833799296 00000100:00100000:1.0:1787602694.756007:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:1.0:1787602694.756021:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+27:14542:x1874436833799296:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602694.756050:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602694.756101:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857200/0x3640686da09dc85a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c28bf expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.756265:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc861 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.756285:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc861 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.756299:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc861 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787602694.756339:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787602694.756491:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc861 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.756500:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc861 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.756507:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc861 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.756514:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406857000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602694.756520:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc861 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.756539:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc861 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.756555:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95c00) 00010000:00010000:1.0:1787602694.756559:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787602694.756565:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc861 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.756572:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc861 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.756631:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857200/0x3640686da09dc85a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28bf expref: 29 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.756643:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d350b502f00) 00010000:00010000:1.0:1787602694.756645:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787602694.756657:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857200/0x3640686da09dc85a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28bf expref: 29 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.756668:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3406857200, rc 0) 00000100:00100000:1.0:1787602694.756815:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+28:14542:x1874436833799296:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 795us (7331us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1787602694.756824:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 48 00000100:00100000:3.0:1787602694.761174:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602694.762045:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833799424 00000100:00100000:2.0:1787602694.762060:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833799424 00000100:00100000:1.0:1787602694.762511:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:1.0:1787602694.762623:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+28:14542:x1874436833799424:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787602694.762681:0:14421:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787602694.762889:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+28:14542:x1874436833799424:12345-192.168.201.26@tcp:53:lhsmtool_posix.0 Request processed in 365us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602694.762897:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 49 00000100:00100000:1.0:1787602694.782004:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602694.782257:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833799680 00000100:00100000:0.0:1787602694.782274:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833799680 00000100:00100000:1.0:1787602694.782693:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 50 00000100:00100000:1.0:1787602694.782708:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+28:14542:x1874436833799680:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602694.782735:0:15127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602694.782785:0:15127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857200/0x3640686da09dc86f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c28c6 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787602694.785869:0:15127:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:1.0:1787602694.785890:0:15127:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1787602694.785997:0:15127:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1787602694.787709:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc876 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.787738:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc876 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.787847:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc876 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.787950:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857200/0x3640686da09dc86f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28c6 expref: 31 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.787978:0:15127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc876 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28c6 expref: 30 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.787988:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d350a016800) 00010000:00010000:1.0:1787602694.787992:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787602694.787996:0:15127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3406857000, rc 0) 00000100:00100000:1.0:1787602694.788711:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+30:14542:x1874436833799680:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 6000us (6715us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1787602694.788722:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 50 00000100:00100000:2.0:1787602694.803018:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602694.803345:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833799936 00000100:00100000:3.0:1787602694.803359:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833799936 00000100:00100000:1.0:1787602694.803629:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:1.0:1787602694.803646:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+30:14542:x1874436833799936:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787602694.803731:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787602694.803798:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857000/0x3640686da09dc876 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28c6 expref: 30 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.803822:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d350a016800) 00010000:00010000:1.0:1787602694.803836:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787602694.803864:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857200/0x3640686da09dc884 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.803904:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857200/0x3640686da09dc884 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.803916:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857200/0x3640686da09dc884 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.808261:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc88b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5e391749 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.808286:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc88b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5e391749 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.808299:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc88b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5e391749 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.809103:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857200/0x3640686da09dc884 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.809114:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857200/0x3640686da09dc884 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.809122:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857200/0x3640686da09dc884 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.809129:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406857200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602694.809133:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857200/0x3640686da09dc884 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.809140:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857200/0x3640686da09dc884 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.809154:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:1.0:1787602694.809165:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602694.809171:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857200/0x3640686da09dc884 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.809177:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857200/0x3640686da09dc884 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.809193:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc88b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5e391749 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.809199:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc88b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5e391749 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.809205:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc88b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5e391749 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.809210:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3406856c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602694.809212:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc88b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5e391749 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.809219:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc88b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5e391749 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.809342:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x5e391749 (ffff8d350a016100) 00010000:00010000:1.0:1787602694.809346:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602694.809350:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc88b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5e391749 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.809356:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406856c00/0x3640686da09dc88b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5e391749 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602694.809480:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+29:14542:x1874436833799936:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 5835us (6473us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787602694.809495:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 51 00000100:00100000:1.0:1787602694.813007:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602694.813387:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833800064 00000100:00100000:0.0:1787602694.813460:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833800064 00000100:00100000:0.0:1787602694.813623:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 52 00000100:00100000:0.0:1787602694.813636:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+29:14542:x1874436833800064:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602694.813663:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602694.813695:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc892 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c28cd expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.813772:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09dc899 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.813806:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09dc899 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.813819:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09dc899 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.813940:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc892 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28cd expref: 31 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.813963:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3000/0x3640686da09dc899 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28cd expref: 30 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.813974:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d350b502300) 00010000:00010000:0.0:1787602694.813977:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787602694.813981:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e3000, rc 0) 00000100:00100000:0.0:1787602694.814061:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+30:14542:x1874436833800064:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 428us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602694.814075:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 52 00000100:00100000:2.0:1787602694.821676:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602694.823728:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833800320 00000100:00100000:3.0:1787602694.823771:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833800320 00000100:00100000:2.0:1787602694.823993:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:2.0:1787602694.824006:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+30:14542:x1874436833800320:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787602694.824168:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703000/0x3640686da09dc8a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.824197:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703000/0x3640686da09dc8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.824212:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703000/0x3640686da09dc8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787602694.825308:0:14422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1787602694.825326:0:14422:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 479771581719ns, next at 480771578390ns, rc = 0 00000004:00010000:2.0:1787602694.825734:0:14422:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abe7b285 reply state 0000000071980270 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703000/0x3640686da09dc8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602694.825901:0:14422:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787602694.826247:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+32:14542:x1874436833800320:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 2238us (4582us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1787602694.826259:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 53 00000100:00100000:2.0:1787602694.831041:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602694.831232:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833800448 00000100:00100000:1.0:1787602694.831250:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833800448 00000100:00100000:1.0:1787602694.831339:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 54 00000100:00100000:1.0:1787602694.831352:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+32:14542:x1874436833800448:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787602694.831386:0:15127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787602694.831413:0:15127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857600/0x3640686da09dc8a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c28d4 expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.831495:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857600/0x3640686da09dc8a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28d4 expref: 33 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.831511:0:15127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857600/0x3640686da09dc8a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28d4 expref: 33 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.831546:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d350b502300) 00010000:00010000:1.0:1787602694.831550:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787602694.831554:0:15127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3406857600, rc 0) 00000100:00100000:1.0:1787602694.831633:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+33:14542:x1874436833800448:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 283us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602694.831641:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 54 00010000:00010000:3.0:1787602694.836328:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703000/0x3640686da09dc8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602694.836351:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703000/0x3640686da09dc8a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602694.836360:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703000/0x3640686da09dc8a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602694.836367:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703000 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602694.836374:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703000/0x3640686da09dc8a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602694.836382:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703000/0x3640686da09dc8a0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602694.836416:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d350b502300) 00010000:00010000:3.0:1787602694.836420:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787602694.836426:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703000/0x3640686da09dc8a0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602694.836433:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703000/0x3640686da09dc8a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787602694.845138:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602694.845376:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833800576 00000100:00100000:2.0:1787602694.845390:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833800576 00000100:00100000:2.0:1787602694.845533:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:2.0:1787602694.845546:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d102a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:342ec688-1cf5-4965-b127-eb784a25a838+5:2352:x1874436833800576:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787602694.846113:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d102a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:342ec688-1cf5-4965-b127-eb784a25a838+6:2352:x1874436833800576:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 566us (988us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787602694.846123:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00080000:1.0:1787602694.848689:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602694.849739:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602694.849943:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833800832 00000100:00100000:3.0:1787602694.849967:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833800832 00000100:00100000:3.0:1787602694.850046:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:3.0:1787602694.850060:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:342ec688-1cf5-4965-b127-eb784a25a838+32:14542:x1874436833800832:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787602694.850431:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:342ec688-1cf5-4965-b127-eb784a25a838+33:14542:x1874436833800832:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 372us (703us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787602694.850440:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 11 00000100:00100000:3.0:1787602694.852467:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602694.852674:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833801088 00000100:00100000:1.0:1787602694.852699:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833801088 00000100:00100000:1.0:1787602694.852814:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00100000:1.0:1787602694.852827:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+33:14542:x1874436833801088:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787602694.852980:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+33:14542:x1874436833801088:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 155us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602694.852988:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 55 00000100:00100000:1.0:1787602694.860339:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602694.861710:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833801216 00000100:00100000:2.0:1787602694.861729:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833801216 00000100:00100000:2.0:1787602694.861861:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 56 00000100:00100000:2.0:1787602694.861874:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+33:14542:x1874436833801216:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602694.861902:0:15127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602694.861935:0:15127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702c00/0x3640686da09dc8ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c28db expref: -99 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.862106:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc8b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.862127:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.862141:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602694.862194:0:15127:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787602694.862228:0:15127:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.862261:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702c00/0x3640686da09dc8ae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28db expref: 35 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.862284:0:15127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28db expref: 34 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.862296:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d350b502300) 00010000:00010000:2.0:1787602694.862299:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787602694.862305:0:15127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503703800, rc 0) 00000100:00100000:2.0:1787602694.862415:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d101c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+34:14542:x1874436833801216:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 543us (2093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602694.862423:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 56 00000100:00100000:3.0:1787602694.868392:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602694.868514:0:16647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833801344 00000100:00100000:2.0:1787602694.868540:0:16647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833801344 00000100:00100000:2.0:1787602694.868615:0:16647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:2.0:1787602694.868629:0:16647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:342ec688-1cf5-4965-b127-eb784a25a838+6:2351:x1874436833801344:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787602694.868652:0:16647:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602694.868682:0:16647:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc8bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c28e2 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787602694.868720:0:16647:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8ca707, blocks: 0x1 00010000:00010000:2.0:1787602694.868773:0:16647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1787602694.868779:0:16647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602694.868791:0:16647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc8bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e2 expref: 7 pid: 16647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.868843:0:16647:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc8bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e2 expref: 7 pid: 16647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.868860:0:16647:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702400, rc 0) 00000100:00100000:2.0:1787602694.868939:0:16647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:342ec688-1cf5-4965-b127-eb784a25a838+7:2351:x1874436833801344:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 313us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602694.868948:0:16647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:3.0:1787602694.872478:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602694.872583:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833801600 00000100:00100000:1.0:1787602694.872596:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833801600 00000100:00100000:1.0:1787602694.872665:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:1.0:1787602694.872677:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+34:14542:x1874436833801600:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787602694.872871:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+34:14542:x1874436833801600:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 196us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602694.872881:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 57 00000100:00100000:1.0:1787602694.875544:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602694.875672:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833801728 00000100:00100000:0.0:1787602694.875687:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833801728 00000100:00100000:2.0:1787602694.875958:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 58 00000100:00100000:2.0:1787602694.875975:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+34:14542:x1874436833801728:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787602694.943889:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000001:00080000:1.0:1787602694.943920:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:1.0:1787602694.943939:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:1.0:1787602694.943944:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787602694.943995:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000100:00100000:1.0:1787602694.944375:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853708800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787602694.944474:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602694.944511:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853708800 00000100:00100000:2.0:1787602694.944523:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853708800 00000100:00080000:3.0:1787602694.944609:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787602694.944615:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787602694.944628:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874436853708800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787602694.944968:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+13:14542:x1874436833801728:12345-192.168.201.26@tcp:44:lhsmtool_posix.0 Request processed in 68993us (69432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602694.944981:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 58 00002000:00010000:2.0:1787602694.948146:0:15106:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787602694.948158:0:15106:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787602694.948161:0:15106:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787602694.948163:0:15106:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787602695 -> 1787602695 00002000:00010000:2.0:1787602694.948167:0:15106:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787602694.948317:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1874436853708800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3687us (3839us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787602694.948331:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787602694.948542:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602694.948648:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833801856 00000100:00100000:0.0:1787602694.948659:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833801856 00000100:00100000:0.0:1787602694.948783:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:0.0:1787602694.948796:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:342ec688-1cf5-4965-b127-eb784a25a838+7:2351:x1874436833801856:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787602694.948938:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:342ec688-1cf5-4965-b127-eb784a25a838+7:2351:x1874436833801856:12345-192.168.201.26@tcp:16:lhsmtool_posix.0 Request processed in 145us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602694.948945:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 16 00000004:00080000:1.0:1787602694.950379:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d350886c000/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787602694.950396:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853708800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787602694.956155:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602694.956254:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833802112 00000100:00100000:2.0:1787602694.956270:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833802112 00000100:00100000:2.0:1787602694.956352:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:2.0:1787602694.956385:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+13:14542:x1874436833802112:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787602694.956473:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602694.956511:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703800/0x3640686da09dc8b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28db expref: 13 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.956538:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d350b502300) 00010000:00010000:2.0:1787602694.956544:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787602694.956583:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702c00/0x3640686da09dc8c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.956601:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702c00/0x3640686da09dc8c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.956612:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702c00/0x3640686da09dc8c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602694.956916:0:14422:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005042add8 reply state 00000000f96fbd43 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702c00/0x3640686da09dc8c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602694.956927:0:14422:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787602694.957063:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:342ec688-1cf5-4965-b127-eb784a25a838+14:14542:x1874436833802112:12345-192.168.201.26@tcp:36:lhsmtool_posix.0 Request processed in 681us (933us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1787602694.957072:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 59 00000100:00100000:3.0:1787602694.959464:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00010000:00010000:1.0:1787602694.962244:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702c00/0x3640686da09dc8c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.962302:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702c00/0x3640686da09dc8c3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.962310:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702c00/0x3640686da09dc8c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.962317:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702c00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:1.0:1787602694.962324:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702c00/0x3640686da09dc8c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.962334:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702c00/0x3640686da09dc8c3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.962359:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d350b502300) 00010000:00010000:1.0:1787602694.962363:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787602694.962370:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702c00/0x3640686da09dc8c3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.962377:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702c00/0x3640686da09dc8c3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602694.962386:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833802240 00000100:00100000:0.0:1787602694.962413:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833802240 00000100:00100000:0.0:1787602694.962499:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:0.0:1787602694.962513:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:342ec688-1cf5-4965-b127-eb784a25a838+7:14542:x1874436833802240:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787602694.962535:0:15103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602694.962560:0:15103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000126244ce/0x3640686da09dc8ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c28e9 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.962601:0:15103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc8bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e2 expref: 8 pid: 16647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.962612:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602694.962617:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602694.962624:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000126244ce/0x3640686da09dc8ca lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e9 expref: 8 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.962669:0:15103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc8bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e2 expref: 8 pid: 16647 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.962686:0:15103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc8bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e2 expref: 8 pid: 16647 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602694.962717:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15103:1874436853708928:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787602694.962880:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35034b6840 going to sleep for 11 seconds 00000100:00100000:1.0:1787602694.965230:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15103:1874436853708928:192.168.201.26@tcp:104: 00010000:00010000:1.0:1787602694.965276:0:15103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000126244ce/0x3640686da09dc8ca lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e9 expref: 8 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602694.965306:0:15103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35354e3800, rc 0) 00000100:00100000:1.0:1787602694.965374:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:342ec688-1cf5-4965-b127-eb784a25a838+8:14542:x1874436833802240:12345-192.168.201.26@tcp:101:lhsmtool_posix.0 Request processed in 2863us (5926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602694.965402:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 17 00000100:00100000:1.0:1787602694.965917:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602694.966195:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833802368 00000100:00100000:0.0:1787602694.966206:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833802368 00010000:00010000:0.0:1787602694.966252:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc8bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e2 expref: 8 pid: 16647 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602694.966296:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:0.0:1787602694.966308:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d100700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:342ec688-1cf5-4965-b127-eb784a25a838+8:2352:x1874436833802368:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602694.966326:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602694.966454:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc8bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e2 expref: 8 pid: 16647 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.966470:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc8bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e2 expref: 8 pid: 16647 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.966495:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b81a3b9/0x3640686da09dc8bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e2 expref: 8 pid: 16647 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.966513:0:14407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602694.966518:0:14407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602694.966536:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000126244ce/0x3640686da09dc8ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e9 expref: 7 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.966568:0:14407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000126244ce/0x3640686da09dc8ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e9 expref: 7 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.966615:0:14407:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000126244ce/0x3640686da09dc8ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e9 expref: 7 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602694.966633:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14407:1874436853709056:192.168.201.26@tcp:105: 00000100:00100000:0.0:1787602694.966964:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35034b6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787602694.970994:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14407:1874436853709056:192.168.201.26@tcp:105: 00010000:00010000:0.0:1787602694.971035:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602694.971127:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d100700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:342ec688-1cf5-4965-b127-eb784a25a838+7:2352:x1874436833802368:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 4819us (5210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602694.971149:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:1.0:1787602694.971490:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602694.971604:0:16647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833802496 00000100:00100000:2.0:1787602694.971613:0:16647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833802496 00000100:00100000:2.0:1787602694.971677:0:16647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:2.0:1787602694.971688:0:16647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d100000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:342ec688-1cf5-4965-b127-eb784a25a838+7:2352:x1874436833802496:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787602694.971979:0:16647:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787602694.971984:0:16647:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787602694 00002000:00010000:2.0:1787602694.972004:0:16647:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787602693 00002000:00010000:2.0:1787602694.972007:0:16647:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787602695 -> 1787602694 00002000:00010000:2.0:1787602694.972010:0:16647:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787602694.972050:0:16647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d100000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:342ec688-1cf5-4965-b127-eb784a25a838+8:2352:x1874436833802496:12345-192.168.201.26@tcp:2:lhsmtool_posix.0 Request processed in 363us (560us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787602694.972057:0:16647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:3.0:1787602694.978397:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602694.978612:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833802624 00000100:00100000:2.0:1787602694.978625:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833802624 00000100:00100000:2.0:1787602694.978702:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:2.0:1787602694.978715:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:342ec688-1cf5-4965-b127-eb784a25a838+8:2352:x1874436833802624:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787602694.978806:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc8d1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.978835:0:15106:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000126244ce/0x3640686da09dc8ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e9 expref: 8 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.978844:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787602694.978849:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787602694.978855:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc8d1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.978901:0:15106:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000126244ce/0x3640686da09dc8ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e9 expref: 8 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.978916:0:15106:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000126244ce/0x3640686da09dc8ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e9 expref: 8 pid: 15103 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602694.978957:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350c88a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15106:1874436853709184:192.168.201.26@tcp:104: 00000100:00100000:2.0:1787602694.979300:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350316d300 going to sleep for 11 seconds 00000100:00100000:1.0:1787602694.982552:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602694.982691:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350c88a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15106:1874436853709184:192.168.201.26@tcp:104: 00010000:00010000:2.0:1787602694.982732:0:15106:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc8d1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602694.982865:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833802752 00000100:00100000:0.0:1787602694.982874:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833802752 00010000:00010000:0.0:1787602694.982925:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000126244ce/0x3640686da09dc8ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e9 expref: 9 pid: 15103 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602694.982970:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:0.0:1787602694.982981:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d100e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:342ec688-1cf5-4965-b127-eb784a25a838+9:2352:x1874436833802752:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787602694.982998:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787602694.983026:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000126244ce/0x3640686da09dc8ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e9 expref: 9 pid: 15103 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.983061:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000126244ce/0x3640686da09dc8ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e9 expref: 9 pid: 15103 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.983101:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000126244ce/0x3640686da09dc8ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28e9 expref: 9 pid: 15103 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.983121:0:14406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602694.983126:0:14406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787602694.983133:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc8d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.983145:0:14406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc8d1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.983179:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787602694.983257:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d100e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:342ec688-1cf5-4965-b127-eb784a25a838+8:2352:x1874436833802752:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 278us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602694.983266:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 15 00010000:00010000:2.0:1787602694.983381:0:15106:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc8d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.983391:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc8d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.983422:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc8d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.983431:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc8d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.983439:0:15106:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc8d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.983447:0:15106:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703800 already unused, calling callback (ffffffffc1656230) 00010000:00010000:2.0:1787602694.983452:0:15106:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc8d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.983472:0:15106:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc8d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.983486:0:15106:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc8d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602694.983494:0:15106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000353e985d/0x3640686da09dc8d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602694.983553:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:342ec688-1cf5-4965-b127-eb784a25a838+7:2352:x1874436833802624:12345-192.168.201.26@tcp:1:lhsmtool_posix.0 Request processed in 4840us (5171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602694.983562:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:3.0:1787602694.989290:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602694.992876:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833803008 00000100:00100000:0.0:1787602694.992899:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833803008 00000100:00100000:0.0:1787602694.993047:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 60 00000100:00100000:0.0:1787602694.993061:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+13:14542:x1874436833803008:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787602694.993203:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc8d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.993261:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc8d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.993276:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc8d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.994100:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8df lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.994121:0:14423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857600/0x3640686da09dc8a7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28d4 expref: 14 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.994131:0:14423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8df lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.994475:0:14423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857600/0x3640686da09dc8a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28d4 expref: 14 pid: 15127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602694.994496:0:14423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857600/0x3640686da09dc8a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28d4 expref: 14 pid: 15127 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602694.994516:0:14423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353534c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14423:1874436853709312:192.168.201.26@tcp:104: 00000100:00100000:0.0:1787602694.994689:0:14423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d35034b6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787602694.998877:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602694.999636:0:14423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353534c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14423:1874436853709312:192.168.201.26@tcp:104: 00010000:00010000:0.0:1787602694.999678:0:14423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8df lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602694.999837:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833803136 00000100:00100000:3.0:1787602694.999847:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833803136 00010000:00010000:2.0:1787602695.000007:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857600/0x3640686da09dc8a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28d4 expref: 15 pid: 15127 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602695.000104:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 16 00000100:00100000:2.0:1787602695.000116:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d101180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:342ec688-1cf5-4965-b127-eb784a25a838+15:2351:x1874436833803136:12345-192.168.201.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787602695.000137:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787602695.000154:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857600/0x3640686da09dc8a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28d4 expref: 15 pid: 15127 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.000169:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857600/0x3640686da09dc8a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28d4 expref: 15 pid: 15127 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.000198:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3406857600/0x3640686da09dc8a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28d4 expref: 15 pid: 15127 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.000249:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d350b502300) 00010000:00010000:2.0:1787602695.000256:0:14408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8df lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.000268:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.000277:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8df lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.000317:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787602695.000405:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d101180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:342ec688-1cf5-4965-b127-eb784a25a838+14:2351:x1874436833803136:12345-192.168.201.26@tcp:103:ldlm_bl.0 Request processed in 283us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602695.000414:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 16 00010000:00010000:1.0:1787602695.001588:0:14423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787602695.001604:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787602695.001922:0:14423:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1787602695.002112:0:14423:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1787602695.002164:0:14423:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1787602695.002297:0:14423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d101f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14423:1874436853709440:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787602695.004825:0:14423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602695.004888:0:14423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d350a108900 going to sleep for 11 seconds 00000100:00100000:0.0:1787602695.009002:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853709440 00000100:00100000:0.0:1787602695.009041:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853709440 00000100:00100000:0.0:1787602695.009152:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787602695.009167:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14423:x1874436853709440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787602695.009354:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14423:x1874436853709440:12345-0@lo:1000:mdt00_002.0 Request processed in 189us (4536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602695.009363:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787602695.009596:0:14423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d101f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14423:1874436853709440:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787602695.010563:0:14423:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1787602695.010678:0:14423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14423:1874436853709568:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787602695.010778:0:14423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602695.010807:0:14423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353976fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787602695.010973:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853709568 00000100:00100000:0.0:1787602695.010981:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853709568 00000100:00100000:0.0:1787602695.011021:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787602695.011031:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14423:x1874436853709568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787602695.011342:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14423:x1874436853709568:12345-0@lo:1000:mdt00_002.0 Request processed in 311us (563us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787602695.011351:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787602695.011910:0:14423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14423:1874436853709568:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787602695.011959:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.011987:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8df lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.011995:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8df lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.012001:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a4e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602695.012006:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8df lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.012014:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8df lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.012034:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d350b502300) 00010000:00010000:3.0:1787602695.012037:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602695.012043:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8df lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.012049:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8df lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.012100:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09dc837 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.012107:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09dc837 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.012113:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09dc837 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.012119:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503703e00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602695.012128:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09dc837 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.012134:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09dc837 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.012483:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95c00) 00010000:00010000:3.0:1787602695.012486:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787602695.012494:0:14423:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc83e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28b8 expref: 17 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.012508:0:14423:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc83e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28b8 expref: 17 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.012517:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc83e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28b8 expref: 17 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.012591:0:14423:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a5a00/0x3640686da09dc83e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28b8 expref: 17 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602695.012609:0:14423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14423:1874436853709696:192.168.201.26@tcp:105: 00000100:00100000:3.0:1787602695.012710:0:14423:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d353976f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787602695.017466:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602695.017649:0:14423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14423:1874436853709696:192.168.201.26@tcp:105: 00010000:00010000:3.0:1787602695.017690:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09dc837 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017702:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503703e00/0x3640686da09dc837 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017820:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432a00/0x3640686da09dc8e6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017838:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432a00/0x3640686da09dc8e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017851:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432a00/0x3640686da09dc8e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017864:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432a00/0x3640686da09dc8e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017871:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432a00/0x3640686da09dc8e6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017879:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432a00/0x3640686da09dc8e6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017886:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d353d432a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602695.017890:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432a00/0x3640686da09dc8e6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017897:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432a00/0x3640686da09dc8e6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017911:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95c00) 00010000:00010000:3.0:1787602695.017914:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787602695.017918:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432a00/0x3640686da09dc8e6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017923:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d353d432a00/0x3640686da09dc8e6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017941:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc8d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017947:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc8d8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017953:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc8d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017959:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35354e3800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:3.0:1787602695.017962:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc8d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017968:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc8d8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017977:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95c00) 00010000:00010000:3.0:1787602695.017980:0:14423:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787602695.017982:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc8d8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.017989:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35354e3800/0x3640686da09dc8d8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787602695.018322:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:342ec688-1cf5-4965-b127-eb784a25a838+17:14542:x1874436833803008:12345-192.168.201.26@tcp:57:lhsmtool_posix.0 Request processed in 25261us (29048us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1787602695.018334:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 60 00000020:00080000:3.0:1787602695.018341:0:14423:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787602695.020207:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833803264 00000100:00100000:0.0:1787602695.020225:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833803264 00000100:00100000:0.0:1787602695.020303:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 12 00000100:00100000:0.0:1787602695.020314:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+17:14541:x1874436833803264:12345-192.168.201.26@tcp:49:bash.0 00000100:00100000:0.0:1787602695.020561:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+17:14541:x1874436833803264:12345-192.168.201.26@tcp:49:bash.0 Request processed in 248us (3115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602695.020569:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 12 00000040:00080000:1.0:1787602695.020930:0:14454:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787602695.020937:0:14454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787602695.020973:0:14454:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787602695.020979:0:14454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787602695.022653:0:16535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787602695.024112:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602695.024261:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833803520 00000100:00100000:0.0:1787602695.024274:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833803520 00000100:00100000:0.0:1787602695.024349:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 13 00000100:00100000:0.0:1787602695.024362:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+17:14542:x1874436833803520:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787602695.025714:0:14425:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787602695.028942:0:14425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1787602695.029052:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602695.029084:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602695.029098:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602695.029107:0:14425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8ed lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602695.029114:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8ed lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602695.029120:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602695.029351:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00010000:00010000:0.0:1787602695.029532:0:14425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787602695.029661:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+19:14542:x1874436833803520:12345-192.168.201.26@tcp:35:lhsmtool_posix.0 Request processed in 5300us (5561us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1787602695.029673:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 13 00000020:00080000:0.0:1787602695.029680:0:14425:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787602695.029724:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833803648 00000100:00100000:0.0:1787602695.029733:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833803648 00000100:00100000:0.0:1787602695.029804:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:0.0:1787602695.029814:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:342ec688-1cf5-4965-b127-eb784a25a838+7:14541:x1874436833803648:12345-192.168.201.26@tcp:101:bash.0 00010000:00010000:0.0:1787602695.029832:0:15105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787602695.029854:0:15105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c69afd3/0x3640686da09dc8f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c28f0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787602695.029903:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8ca706, atime: 0x6a8ca705, ctime: 0x6a8ca706, blocks: 0x1 00010000:00010000:0.0:1787602695.029928:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=479s v=(0 0) 00010000:00010000:0.0:1787602695.029934:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787602695.029945:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c69afd3/0x3640686da09dc8f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28f0 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602695.029961:0:15105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c69afd3/0x3640686da09dc8f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28f0 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787602695.029973:0:15105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d35110a4800, rc 0) 00000100:00100000:0.0:1787602695.029998:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:342ec688-1cf5-4965-b127-eb784a25a838+8:14541:x1874436833803648:12345-192.168.201.26@tcp:101:bash.0 Request processed in 185us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787602695.030004:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00010000:00010000:3.0:1787602695.037472:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787602695.037493:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.037531:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d35110a4e00 already unused, calling callback (ffffffffc1656230) 00010000:00010000:3.0:1787602695.037537:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.037549:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.037574:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d350b502300) 00010000:00010000:3.0:1787602695.037577:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787602695.037583:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8ed lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787602695.037590:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d35110a4e00/0x3640686da09dc8ed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787602695.038048:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602695.038494:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833803904 00000100:00100000:3.0:1787602695.038510:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833803904 00010000:00010000:2.0:1787602695.038682:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602695.038686:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787602695.038689:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602695.038833:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 14 00000100:00100000:3.0:1787602695.038845:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:342ec688-1cf5-4965-b127-eb784a25a838+19:14541:x1874436833803904:12345-192.168.201.26@tcp:35:bash.0 00000001:00080000:3.0:1787602695.039256:0:14424:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1787602695.039375:0:14424:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1787602695.039537:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:342ec688-1cf5-4965-b127-eb784a25a838+22:14541:x1874436833803904:12345-192.168.201.26@tcp:35:bash.0 Request processed in 692us (1499us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1787602695.039546:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 14 00000020:00080000:3.0:1787602695.039552:0:14424:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787602695.131096:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602695.131266:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833804160 00000100:00100000:2.0:1787602695.131278:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833804160 00000100:00100000:2.0:1787602695.131349:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:2.0:1787602695.131362:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+22:14552:x1874436833804160:12345-192.168.201.26@tcp:101:lfs.0 00010000:00010000:2.0:1787602695.131409:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787602695.131439:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc8fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb95c978ab75c28f7 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787602695.131788:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787602695.131994:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc8fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28f7 expref: 24 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.132011:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d350b502100) 00010000:00010000:2.0:1787602695.132015:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787602695.132021:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc8fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.26@tcp remote: 0xb95c978ab75c28f7 expref: 24 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.132036:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d3503702a00, rc 0) 00000100:00100000:2.0:1787602695.132124:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+23:14552:x1874436833804160:12345-192.168.201.26@tcp:101:lfs.0 Request processed in 763us (1050us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1787602695.132132:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 61 00000100:00100000:1.0:1787602695.137896:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:2.0:1787602695.138053:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833804288 00000100:00100000:2.0:1787602695.138065:0:15127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833804288 00000100:00100000:2.0:1787602695.138158:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 62 00000100:00100000:2.0:1787602695.138170:0:15127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+23:14552:x1874436833804288:12345-192.168.201.26@tcp:34:lfs.0 00010000:00010000:2.0:1787602695.138281:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc909 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138301:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc909 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138317:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc909 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138336:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc910 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138344:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc910 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138368:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc910 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138662:0:15127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc917 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138669:0:15127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc917 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138674:0:15127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc917 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787602695.138717:0:15127:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc917 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138730:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc909 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138734:0:15127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc909 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138740:0:15127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc909 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138764:0:15127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702a00 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602695.138768:0:15127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc909 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138774:0:15127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc909 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138785:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d3529dc7600) 00010000:00010000:2.0:1787602695.138792:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602695.138797:0:15127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc909 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138801:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702a00/0x3640686da09dc909 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138811:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc910 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138814:0:15127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc910 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138818:0:15127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc910 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138824:0:15127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702200 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602695.138827:0:15127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc910 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138833:0:15127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc910 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138841:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d3504d95500) 00010000:00010000:2.0:1787602695.138844:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602695.138846:0:15127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc910 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138852:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702200/0x3640686da09dc910 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138868:0:15127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc917 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138880:0:15127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc917 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138887:0:15127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc917 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138892:0:15127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d3503702800 already unused, calling callback (ffffffffc20604f0) 00010000:00010000:2.0:1787602695.138895:0:15127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc917 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138901:0:15127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc917 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138909:0:15127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d3504d95c00) 00010000:00010000:2.0:1787602695.138912:0:15127:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787602695.138915:0:15127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc917 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787602695.138921:0:15127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d3503702800/0x3640686da09dc917 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15127 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787602695.139029:0:15127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:342ec688-1cf5-4965-b127-eb784a25a838+23:14552:x1874436833804288:12345-192.168.201.26@tcp:34:lfs.0 Request processed in 858us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602695.139039:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 62 00000100:00100000:1.0:1787602695.141329:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:0.0:1787602695.141430:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833804544 00000100:00100000:0.0:1787602695.141441:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833804544 00000100:00100000:0.0:1787602695.141496:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:0.0:1787602695.141505:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+23:14552:x1874436833804544:12345-192.168.201.26@tcp:35:lfs.0 00000100:00100000:0.0:1787602695.142064:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:342ec688-1cf5-4965-b127-eb784a25a838+24:14552:x1874436833804544:12345-192.168.201.26@tcp:35:lfs.0 Request processed in 557us (747us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1787602695.142121:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 15 00000100:00100000:1.0:1787602695.379705:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602695.379789:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602695.379831:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602695.379896:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602695.379925:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602695.379945:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602695.379973:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602695.380010:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833804928 00000100:00100000:1.0:1787602695.380023:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833804928 00000100:00100000:1.0:1787602695.380083:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833805440 00000100:00100000:1.0:1787602695.380087:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833805440 00000100:00100000:1.0:1787602695.380114:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833805056 00000100:00100000:1.0:1787602695.380117:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833805056 00000100:00100000:1.0:1787602695.380131:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833805312 00000100:00100000:1.0:1787602695.380133:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833805312 00000100:00100000:3.0:1787602695.380301:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833804672 00000100:00100000:3.0:1787602695.380306:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833804672 00000100:00100000:3.0:1787602695.380344:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 125 00000100:00100000:3.0:1787602695.380358:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:2351:x1874436833804672:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602695.380464:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94d220dc-ff0a-4980-bb6f-25cb6d7fc683+13:2351:x1874436833804672:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 108us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602695.380472:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 125 00000100:00100000:3.0:1787602695.380664:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:3.0:1787602695.380673:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d101f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:342ec688-1cf5-4965-b127-eb784a25a838+8:2351:x1874436833804928:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602695.380714:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d101f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:342ec688-1cf5-4965-b127-eb784a25a838+8:2351:x1874436833804928:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 42us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602695.380721:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 18 00000100:00100000:3.0:1787602695.380738:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:3.0:1787602695.380782:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:01230f64-3401-4225-ba12-2a367927804a+5:2351:x1874436833805440:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602695.380809:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:01230f64-3401-4225-ba12-2a367927804a+5:2351:x1874436833805440:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 64us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602695.380815:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 19 00000100:00100000:3.0:1787602695.380850:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:3.0:1787602695.380857:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:342ec688-1cf5-4965-b127-eb784a25a838+5:2351:x1874436833805056:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602695.380881:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:342ec688-1cf5-4965-b127-eb784a25a838+5:2351:x1874436833805056:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 25us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602695.380888:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 20 00000100:00100000:3.0:1787602695.380907:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833805184 00000100:00100000:3.0:1787602695.380912:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833805184 00000100:00100000:3.0:1787602695.380942:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833804800 00000100:00100000:3.0:1787602695.380945:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833804800 00000100:00100000:3.0:1787602695.380965:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 30 00000100:00100000:3.0:1787602695.380971:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01230f64-3401-4225-ba12-2a367927804a+6:2351:x1874436833805184:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602695.381017:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:01230f64-3401-4225-ba12-2a367927804a+6:2351:x1874436833805184:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 46us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602695.381042:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 30 00000100:00100000:3.0:1787602695.381055:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00100000:3.0:1787602695.381061:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+24:2351:x1874436833804800:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:3.0:1787602695.381098:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:342ec688-1cf5-4965-b127-eb784a25a838+24:2351:x1874436833804800:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 37us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602695.381104:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 31 00000100:00100000:1.0:1787602695.381715:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:1.0:1787602695.381727:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01230f64-3401-4225-ba12-2a367927804a+5:2351:x1874436833805312:12345-192.168.201.26@tcp:400:kworker.0 00000100:00100000:1.0:1787602695.381799:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:01230f64-3401-4225-ba12-2a367927804a+5:2351:x1874436833805312:12345-192.168.201.26@tcp:400:kworker.0 Request processed in 76us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602695.381806:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00080000:1.0:1787602695.387993:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787602695.388009:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787602695.388013:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787602696.049234:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787602696.301931:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787602696.301965:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d4b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853709824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787602696.302078:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602696.302277:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853709824 00000100:00100000:1.0:1787602696.302288:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853709824 00000100:00100000:1.0:1787602696.302362:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787602696.302372:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353534ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853709824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787602696.302416:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787602696.302469:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353534ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874436853709824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602696.302475:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787602696.302521:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d4b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1874436853709824:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787602696.302608:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787602696.306541:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d4b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853710080:0@lo:400:kworker.0 00000100:00100000:1.0:1787602696.306640:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602696.306694:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787602696.306700:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d4b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853710208:0@lo:400:kworker.0 00000100:00100000:1.0:1787602696.306730:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787602696.306806:0:16647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853710080 00000100:00100000:1.0:1787602696.306815:0:16647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853710080 00000100:00100000:1.0:1787602696.306889:0:16647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787602696.306901:0:16647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3301:x1874436853710080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602696.306961:0:16647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3301:x1874436853710080:12345-0@lo:400:kworker.0 Request processed in 63us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602696.306970:0:16647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787602696.306998:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853710208 00000100:00100000:1.0:1787602696.307002:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853710208 00000100:00100000:1.0:1787602696.307033:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787602696.307039:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d353d4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853710208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787602696.307084:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d353d4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874436853710208:12345-0@lo:400:kworker.0 Request processed in 44us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787602696.307091:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787602696.307116:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602696.307154:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d4b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874436853710208:0@lo:400:kworker.0 00000100:00100000:1.0:1787602696.307166:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d4b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1874436853710080:0@lo:400:kworker.0 00000100:00100000:2.0:1787602696.307273:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d4b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853710336:0@lo:400:kworker.0 00000100:00100000:2.0:1787602696.307309:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602696.307340:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787602696.307347:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d4b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853709952:0@lo:400:kworker.0 00000100:00100000:2.0:1787602696.307395:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602696.307424:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d353d4b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853710464:0@lo:400:kworker.0 00000100:00100000:2.0:1787602696.307446:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787602696.307472:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853709952 00000100:00100000:2.0:1787602696.307476:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853709952 00000100:00100000:2.0:1787602696.307511:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787602696.307518:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d3534f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+19:3303:x1874436853709952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602696.307554:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d3534f5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:704a385b-7757-43d8-8441-546b4c8b60c7+19:3303:x1874436853709952:12345-0@lo:400:kworker.0 Request processed in 36us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602696.307560:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787602696.307592:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853710336 00000100:00100000:2.0:1787602696.307595:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853710336 00000100:00100000:2.0:1787602696.307618:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853710464 00000100:00100000:2.0:1787602696.307621:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853710464 00000100:00100000:2.0:1787602696.307639:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787602696.307646:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853710336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602696.307676:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874436853710336:12345-0@lo:400:kworker.0 Request processed in 31us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602696.307683:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787602696.307694:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787602696.307700:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350c88aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853710464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787602696.307724:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350c88aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874436853710464:12345-0@lo:400:kworker.0 Request processed in 25us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602696.307729:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787602696.307774:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d4b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:704a385b-7757-43d8-8441-546b4c8b60c7:3303:1874436853709952:0@lo:400:kworker.0 00000100:00100000:2.0:1787602696.307783:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d4b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1874436853710464:0@lo:400:kworker.0 00000100:00100000:2.0:1787602696.307803:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d353d4b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1874436853710336:0@lo:400:kworker.0 00000100:00080000:1.0:1787602696.311000:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1787602696.982723:0:16686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:0.0:1787602697.069048:0:16535:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787602697.839801:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787602697.839836:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d350886d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853710592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602697.839937:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787602697.840054:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436853710592 00000100:00100000:3.0:1787602697.840065:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436853710592 00000100:00100000:3.0:1787602697.840132:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787602697.840145:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874436853710592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787602697.840199:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787602697.840255:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874436853710592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787602697.840263:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787602697.840319:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d350886d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1874436853710592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787602697.943419:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:3.0:1787602697.943488:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.26@tcp (source: 12345-192.168.201.26@tcp) 00000100:00100000:1.0:1787602697.943649:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833805568 00000100:00100000:1.0:1787602697.943662:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833805568 00002000:00100000:1.0:1787602697.943784:0:15109:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff8d350886d180 x1874436833805568/t0(0) o4->342ec688-1cf5-4965-b127-eb784a25a838@192.168.201.26@tcp:533/0 lens 504/0 e 0 to 0 dl 1787602708 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787602697.943811:0:15109:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d350886d180 with x1874436833805568 ext(0->8) 00002000:00010000:1.0:1787602697.943819:0:15109:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d350886d180 00000100:00100000:1.0:1787602697.943851:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 0 00000100:00100000:1.0:1787602697.943863:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:342ec688-1cf5-4965-b127-eb784a25a838+8:2353:x1874436833805568:12345-192.168.201.26@tcp:4:bash.0 00000100:00080000:3.0:1787602697.944217:0:14417:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787602697.946034:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:342ec688-1cf5-4965-b127-eb784a25a838+10:2353:x1874436833805568:12345-192.168.201.26@tcp:4:bash.0 Request processed in 2147us (2605us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787602697.946051:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 0 00002000:00100000:1.0:1787602697.946070:0:15109:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff8d350886d180 x1874436833805568/t8589934598(0) o4->342ec688-1cf5-4965-b127-eb784a25a838@192.168.201.26@tcp:533/0 lens 504/448 e 0 to 0 dl 1787602708 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787602697.946082:0:15109:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d350886d180 with x1874436833805568 ext(0->8) 00002000:00010000:1.0:1787602697.946090:0:15109:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d350886d180 00000100:00100000:2.0:1787602697.947159:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874436833805696 00000100:00100000:2.0:1787602697.947178:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874436833805696 00000100:00100000:2.0:1787602697.947268:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.26@tcp, seq: 21 00000100:00100000:2.0:1787602697.947281:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d350886c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:342ec688-1cf5-4965-b127-eb784a25a838+10:2353:x1874436833805696:12345-192.168.201.26@tcp:16:kworker.0 00000001:00080000:1.0:1787602698.073517:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:1.0:1787602698.073541:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000100:00100000:2.0:1787602698.073879:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d350886c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:342ec688-1cf5-4965-b127-eb784a25a838+6:2353:x1874436833805696:12345-192.168.201.26@tcp:16:kworker.0 Request processed in 126592us (130382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787602698.073892:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.26@tcp, seq: 21 00010000:00010000:1.0:1787602698.092990:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30188 lines, 30188 kept, 0 dropped, 0 bad.